Jul 07 22:15:12 devstack cinder-volume[76380]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 22:15:12 devstack cinder-volume[76380]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:15:12 devstack cinder-volume[76380]: we strongly recommend against using it for new projects. Jul 07 22:15:12 devstack cinder-volume[76380]: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:15:12 devstack cinder-volume[76380]: framework. For more detail see Jul 07 22:15:12 devstack cinder-volume[76380]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:15:12 devstack cinder-volume[76380]: import eventlet # noqa Jul 07 22:15:14 devstack cinder-volume[76380]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:15:14 devstack cinder-volume[76380]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:15:14 devstack cinder-volume[76380]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:15:15 devstack cinder-volume[76380]: INFO dbcounter [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Registered counter for database cinder Jul 07 22:15:15 devstack cinder-volume[76380]: DEBUG oslo_db.sqlalchemy.engines [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG dbcounter [-] [76380] Writer thread running {{(pid=76380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:15:16 devstack cinder-volume[76380]: INFO cinder.rpc [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 22:15:16 devstack cinder-volume[76380]: INFO cinder.rpc [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_db.sqlalchemy.engines [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:15:16 devstack cinder-volume[76380]: INFO cinder.volume.manager [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Determined volume DB was empty at startup. Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG cinder.volume.manager [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76380) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 22:15:16 devstack cinder-volume[76380]: INFO cinder.volume.manager [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 22:15:16 devstack cinder-volume[76380]: WARNING stevedore.named [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 22:15:16 devstack cinder-volume[76380]: WARNING castellan.key_manager [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:15:16 devstack cinder-volume[76380]: WARNING cinder.keymgr.conf_key_mgr [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG cinder.volume.drivers.lvm [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76380) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_concurrency.processutils [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_concurrency.processutils [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] CMD "cinder-rtstool verify" returned: 0 in 0.471s {{(pid=76380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_db.sqlalchemy.engines [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:15:16 devstack cinder-volume[76380]: INFO cinder.rpc [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 22:15:16 devstack cinder-volume[76380]: INFO cinder.rpc [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 22:15:16 devstack cinder-volume[76380]: WARNING stevedore.named [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 22:15:16 devstack cinder-volume[76380]: WARNING castellan.key_manager [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:15:16 devstack cinder-volume[76380]: INFO cinder.volume.manager [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_db.sqlalchemy.engines [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:15:16 devstack cinder-volume[76380]: INFO oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Starting 1 workers Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Started child 76534 {{(pid=76380) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Full set of CONF: {{(pid=76380) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] ******************************************************************************** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Configuration options gathered from: {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] ================================================================================ {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] allow_availability_zone_fallback = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] allow_compression_on_image_upload = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] allowed_direct_url_schemes = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] api_rate_limit = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] auth_strategy = keystone {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] az_cache_duration = 3600 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_availability_zone = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_host = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_stats_polling_interval = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backup_api_class = cinder.backup.api.API {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backup_name_template = backup-%s {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backup_use_same_host = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backup_use_temp_snapshot = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] chap_password = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] chap_username = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_internal_tenant_project_id = 6b81fcbd8df7458cbda17f5455a307c9 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_internal_tenant_user_id = a38980985fef4cc98666938982c96bf8 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cloned_volume_same_az = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cluster = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] compression_format = gzip {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] compute_api_class = cinder.compute.nova.API {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] config_dir = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] config_source = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76534]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] control_exchange = openstack {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] debug = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] default_availability_zone = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] default_group_type = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] default_volume_type = lvmdriver-1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] disk_geometry = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] driver_client_cert = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] driver_client_cert_key = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] driver_data_namespace = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] driver_ssl_cert_path = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] driver_ssl_cert_verify = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] driver_use_ssl = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] enable_force_upload = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] enable_new_services = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] enable_unsupported_driver = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] enforce_multipath_for_image_xfer = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] filter_function = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_api_insecure = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_api_ssl_compression = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_ca_certificates_file = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_catalog_info = image:glance:publicURL {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_certfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:16 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_keyfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_num_retries = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance_request_timeout = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] goodness_function = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] graceful_shutdown_timeout = 5 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] group_api_class = cinder.group.api.API {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] host = devstack {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_compress_on_upload = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_conversion_address_space_limit = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_conversion_cpu_limit = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_conversion_disable = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_upload_use_cinder_backend = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_upload_use_internal_tenant = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_volume_cache_enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_volume_cache_max_count = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] image_volume_cache_max_size_gb = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] init_host_max_objects_retrieval = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] instance_format = [instance: %(uuid)s] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] iscsi_target_flags = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] iscsi_write_cache = on {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] iser_helper = tgtadm {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] iser_ip_address = 192.168.122.205 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] iser_port = 3260 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_color = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_config_append = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_dir = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_file = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_options = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_rotate_interval = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_rotate_interval_type = days {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] log_rotation_type = none {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] max_age = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] max_logfile_count = 30 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] max_logfile_size_mb = 200 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] max_over_subscription_ratio = 20.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] message_reap_interval = 86400 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] message_ttl = 2592000 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] migration_create_volume_timeout_secs = 300 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] monkey_patch = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] monkey_patch_modules = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] my_ip = 192.168.122.205 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] no_snapshot_gb_quota = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] num_iser_scan_tries = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] num_shell_tries = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] num_volume_device_scan_tries = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] nvmeof_conn_info_version = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] nvmet_ns_id = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] nvmet_port_id = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] osapi_max_limit = 1000 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] osapi_volume_ext_list = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76534]: INFO cinder.volume.manager [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] osapi_volume_listen_port = 8776 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] osapi_volume_use_ssl = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] osapi_volume_workers = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] per_volume_size_limit = -1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] periodic_fuzzy_delay = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] periodic_interval = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] public_endpoint = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] publish_errors = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] quota_backup_gigabytes = 1000 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] quota_backups = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] quota_gigabytes = 1000 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] quota_groups = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] quota_snapshots = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] quota_volumes = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] rate_limit_burst = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] rate_limit_except_level = CRITICAL {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] rate_limit_interval = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] reinit_driver_count = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] replication_device = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] report_discard_supported = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] report_interval = 120 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] reservation_clean_interval = 86400 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] reservation_expire = 86400 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] reserved_image_namespaces = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] reserved_percentage = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] rpc_response_timeout = 120 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] run_external_periodic_tasks = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] scst_target_driver = iscsi {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] scst_target_iqn_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_down_time = 720 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] shell_completion = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] snapshot_name_template = snapshot-%s {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] snapshot_same_host = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] split_loggers = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] state_path = /opt/stack/data/cinder {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] storage_availability_zone = nova {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] storage_protocol = iSCSI {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] syslog_log_facility = LOG_USER {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] target_helper = lioadm {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] target_ip_address = 192.168.122.205 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] target_port = 3260 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] target_protocol = iscsi {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] target_secondary_ip_addresses = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] trace_flags = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] transport_url = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] until_refresh = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] use_chap_auth = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] use_default_quota_class = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] use_journal = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] use_json = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] use_multipath_for_image_xfer = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] use_stderr = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] use_syslog = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] verify_glance_signatures = enabled {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_api_class = cinder.volume.api.API {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_backend_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_clear = zero {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_clear_ionice = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_clear_size = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_copy_bps_limit = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_dd_blocksize = 1M {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_name_template = volume-%s {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_service_inithost_offload = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volume_usage_audit_period = month {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] zoning_mode = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_concurrency.disable_process_locking = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.auth_section = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.auth_type = password {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.auth_version = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.cache = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.certfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.include_service_catalog = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.insecure = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.interface = public {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.keyfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_password = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcache_username = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.region_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.service_type = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.backend = dogpile.cache.null {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.backend_argument = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.backend_expiration_time = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.config_prefix = cache.oslo {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.debug_cache_backend = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.enable_retry_client = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.enable_socket_keepalive = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.expiration_time = 600 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.hashclient_retry_attempts = 2 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.memcache_dead_retry = 300 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.memcache_pool_maxsize = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.memcache_sasl_enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.password = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.proxies = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.redis_db = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 22:15:17 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.redis_server = localhost:6379 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.retry_attempts = 2 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.retry_delay = 0.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.socket_keepalive_count = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.socket_keepalive_idle = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.socket_keepalive_interval = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.socket_timeout = 1.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.tls_allowed_ciphers = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.tls_cafile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.tls_certfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.tls_enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.tls_keyfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cache.username = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] coordination.backend_url = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.asyncio_connection = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.asyncio_slave_connection = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.backend = sqlalchemy {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.connection = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.connection_debug = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.connection_parameters = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.connection_recycle_time = 3600 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.connection_trace = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.db_inc_retry_interval = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.db_max_retries = 20 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.db_max_retry_interval = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.db_retry_interval = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.max_overflow = 50 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.max_pool_size = 5 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.max_retries = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.mysql_wsrep_sync_wait = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.pool_timeout = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.retry_interval = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.slave_connection = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.sqlite_synchronous = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.synchronous_reader = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] database.use_db_reconnect = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.connection_string = messaging:// {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.es_doc_type = notification {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.es_scroll_size = 10000 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.es_scroll_time = 2m {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.filter_error_trace = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.hmac_keys = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.sentinel_service_name = mymaster {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.socket_timeout = 0.1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.trace_requests = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler.trace_sqlalchemy = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler_jaeger.process_tags = {} {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler_jaeger.service_name_prefix = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] profiler_otlp.service_name_prefix = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.enforce_new_defaults = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.enforce_scope = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.policy_default_rule = default {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.policy_file = policy.yaml {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] privsep_osbrick.group = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] privsep_osbrick.helper_command = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] privsep_osbrick.user = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_sys_admin.group = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_sys_admin.helper_command = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] cinder_sys_admin.user = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.auth_section = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.auth_type = password {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.cafile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.certfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.collect_timing = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.insecure = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.keyfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.send_service_user_token = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.split_loggers = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] service_user.timeout = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.auth_section = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.auth_type = password {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.certfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.collect_timing = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.insecure = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.keyfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.region_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.split_loggers = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] glance.timeout = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.backend_availability_zone = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.chap_password = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.chap_username = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.disk_geometry = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.driver_client_cert = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.driver_client_cert_key = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.driver_data_namespace = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.driver_use_ssl = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.extra_capabilities = {} {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.filter_function = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.goodness_function = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.iscsi_target_flags = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.iscsi_write_cache = on {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.iser_helper = tgtadm {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.iser_port = 3260 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.lvm_share_target = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.lvm_type = auto {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.num_shell_tries = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.replication_device = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.report_discard_supported = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.reserved_percentage = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.target_helper = tgtadm {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.target_port = 3260 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.target_protocol = iscsi {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.trace_flags = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.unique_fqdn_network = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.use_chap_auth = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_backend_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_clear = zero {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_clear_ionice = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_clear_size = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_reports.file_event_handler = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_reports.log_dir = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.backend_host = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.chap_password = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.chap_username = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.disk_geometry = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.driver_client_cert = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.extra_capabilities = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.filter_function = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.goodness_function = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.iser_helper = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.iser_ip_address = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.iser_port = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.lvm_share_target = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.lvm_type = auto {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.num_shell_tries = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.replication_device = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.report_discard_supported = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.reserved_percentage = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.scst_target_driver = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.storage_protocol = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.target_helper = lioadm {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.target_ip_address = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.target_port = 3260 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.trace_flags = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.use_chap_auth = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_clear = zero {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_clear_size = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] lvmdriver-1.volumes_dir = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.ssl = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_notifications.driver = [] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_notifications.retry = -1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] key_manager.fixed_key = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.barbican_api_version = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.barbican_endpoint = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.barbican_endpoint_type = public {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.barbican_region_name = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.cafile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.certfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.collect_timing = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.insecure = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.keyfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.number_of_retries = 60 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.retry_delay = 1 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.send_service_user_token = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.split_loggers = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.timeout = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.verify_ssl = True {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican.verify_ssl_path = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.auth_section = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.auth_type = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.cafile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.certfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.collect_timing = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.insecure = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.keyfile = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.split_loggers = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] barbican_service_user.timeout = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.approle_role_id = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.approle_secret_id = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.kv_mountpoint = secret {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.kv_path = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.kv_version = 2 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.namespace = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.root_token_id = **** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.ssl_ca_crt_file = None {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.timeout = 60.0 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.use_ssl = False {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:15:17 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] ******************************************************************************** {{(pid=76380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 22:15:17 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.746s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:17 devstack sudo[76546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:17 devstack sudo[76546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:18 devstack sudo[76546]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.711s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:18 devstack cinder-volume[76534]: INFO cinder.brick.local_dev.lvm [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 22:15:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:18 devstack sudo[76814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:15:18 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:19 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:19 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:19 devstack cinder-volume[76534]: DEBUG cinder.brick.local_dev.lvm [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76534) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 22:15:19 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:19 devstack sudo[77029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:19 devstack sudo[77029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:20 devstack sudo[77029]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:21 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.686s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:21 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:21 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:21 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:21 devstack sudo[77355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:21 devstack sudo[77355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:22 devstack sudo[77355]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:22 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.005s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:22 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:22 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:22 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:22 devstack sudo[77359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 22:15:22 devstack sudo[77359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:23 devstack sudo[77359]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:23 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.940s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:23 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:23 devstack sudo[77363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:15:23 devstack sudo[77363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:23 devstack sudo[77363]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:23 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.974s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:23 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:24 devstack sudo[77375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:15:24 devstack sudo[77375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:24 devstack sudo[77375]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:24 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.774s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:24 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:24 devstack sudo[77385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:15:24 devstack sudo[77385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:25 devstack sudo[77385]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:25 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:25 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:25 devstack sudo[77388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:25 devstack sudo[77388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:26 devstack sudo[77388]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:26 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:26 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:26 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:26 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:26 devstack sudo[77392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:26 devstack sudo[77392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:26 devstack cinder-volume[76380]: DEBUG dbcounter [-] [76380] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:15:27 devstack sudo[77392]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:27 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.911s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:27 devstack cinder-volume[76534]: INFO cinder.volume.drivers.lvm [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 22:15:27 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:27 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:27 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:27 devstack sudo[77444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:27 devstack sudo[77444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:27 devstack sudo[77444]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:27 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.694s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:27 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Updating volume stats {{(pid=76534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:15:27 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:27 devstack sudo[77520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:15:27 devstack sudo[77520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:28 devstack sudo[77520]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:28 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:28 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:28 devstack sudo[77523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:15:28 devstack sudo[77523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:29 devstack sudo[77523]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:29 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:29 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:29 devstack sudo[77526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:29 devstack sudo[77526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:29 devstack sudo[77526]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:29 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:29 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:29 devstack sudo[77531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:15:29 devstack sudo[77531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:30 devstack sudo[77531]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:30 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.766s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:30 devstack cinder-volume[76534]: INFO cinder.volume.driver [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Driver hasn't implemented _init_vendor_properties() Jul 07 22:15:30 devstack cinder-volume[76534]: DEBUG cinder.volume.driver [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76534) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 22:15:30 devstack cinder-volume[76534]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:15:30 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writer thread running {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:15:30 devstack cinder-volume[76534]: DEBUG cinder.db.api [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Building query based on filter {{(pid=76534) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 22:15:30 devstack cinder-volume[76534]: DEBUG cinder.image.image_utils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76534) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 22:15:30 devstack cinder-volume[76534]: INFO cinder.keymgr.migration [None req-2212c09c-70bc-4a33-ae50-202259d1316d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 22:15:30 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Updating volume stats {{(pid=76534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:15:30 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:30 devstack sudo[77538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:15:30 devstack sudo[77538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:31 devstack sudo[77538]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:31 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:31 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:31 devstack sudo[77541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:15:31 devstack sudo[77541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:32 devstack sudo[77541]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:32 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:32 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:32 devstack sudo[77544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:32 devstack sudo[77544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:32 devstack sudo[77544]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:33 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.739s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:33 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:33 devstack sudo[77547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:15:33 devstack sudo[77547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:33 devstack sudo[77547]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:33 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:33 devstack cinder-volume[76534]: DEBUG cinder.manager [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Notifying Schedulers of capabilities ... {{(pid=76534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:33 devstack cinder-volume[76534]: INFO cinder.volume.manager [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Driver initialization completed successfully. Jul 07 22:15:33 devstack cinder-volume[76534]: INFO cinder.manager [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Initiating service 2 cleanup Jul 07 22:15:33 devstack cinder-volume[76534]: INFO cinder.manager [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Service 2 cleanup completed. Jul 07 22:15:33 devstack cinder-volume[76534]: DEBUG cinder.service [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Creating RPC server for service cinder-volume {{(pid=76534) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 22:15:33 devstack cinder-volume[76534]: DEBUG cinder.service [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76534) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 22:15:33 devstack cinder-volume[76534]: INFO cinder.volume.manager [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 22:15:33 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Updating volume stats {{(pid=76534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:15:33 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:33 devstack sudo[77550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:15:33 devstack sudo[77550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:34 devstack sudo[77550]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:34 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:34 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:34 devstack sudo[77556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:15:34 devstack sudo[77556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:35 devstack sudo[77556]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:35 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:35 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:35 devstack sudo[77559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:15:35 devstack sudo[77559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:35 devstack sudo[77559]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:35 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:35 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:35 devstack sudo[77562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:15:35 devstack sudo[77562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:36 devstack sudo[77562]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:36 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:36 devstack cinder-volume[76534]: INFO cinder.volume.manager [None req-f1f9a0ee-654b-4c9e-9a9f-a8dbee32ed5a None None] Driver post RPC initialization completed successfully. Jul 07 22:15:46 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:15:46 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:16:16 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:16:16 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Updating volume stats {{(pid=76534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:16:16 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:16 devstack sudo[77624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:16:16 devstack sudo[77624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:17 devstack sudo[77624]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:17 devstack sudo[77627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:16:17 devstack sudo[77627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:18 devstack sudo[77627]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:18 devstack sudo[77630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:16:18 devstack sudo[77630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:18 devstack sudo[77630]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:18 devstack sudo[77633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:16:18 devstack sudo[77633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:19 devstack sudo[77633]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:19 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:19 devstack cinder-volume[76534]: DEBUG cinder.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Notifying Schedulers of capabilities ... {{(pid=76534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:19 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager._thread_info {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:16:19 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread count: 6 {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:16:19 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread info: [<_MainThread(MainThread, started 134460633686144)>, , , , , ] {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:17:16 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:17:16 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Updating volume stats {{(pid=76534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:17:16 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:16 devstack sudo[78397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:17:16 devstack sudo[78397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:17 devstack sudo[78397]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:17 devstack sudo[78400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:17:17 devstack sudo[78400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:18 devstack sudo[78400]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:18 devstack sudo[78408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:17:18 devstack sudo[78408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:18 devstack sudo[78408]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.729s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:18 devstack sudo[78411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:17:18 devstack sudo[78411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:19 devstack sudo[78411]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:19 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:19 devstack cinder-volume[76534]: DEBUG cinder.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Notifying Schedulers of capabilities ... {{(pid=76534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:17:19 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager._thread_info {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:17:19 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread count: 6 {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:17:19 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread info: [<_MainThread(MainThread, started 134460633686144)>, , , , , ] {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:17:46 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:18:16 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:18:16 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Updating volume stats {{(pid=76534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:18:16 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:16 devstack sudo[79607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:18:16 devstack sudo[79607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:17 devstack sudo[79607]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:17 devstack sudo[79708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:18:17 devstack sudo[79708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:18 devstack sudo[79708]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:18 devstack sudo[79711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:18:18 devstack sudo[79711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:18 devstack sudo[79711]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:18 devstack sudo[79783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:18:18 devstack sudo[79783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:19 devstack sudo[79783]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:19 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:19 devstack cinder-volume[76534]: DEBUG cinder.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Notifying Schedulers of capabilities ... {{(pid=76534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:19:16 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager._thread_info {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:19:16 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread count: 6 {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:19:16 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread info: [<_MainThread(MainThread, started 134460633686144)>, , , , , ] {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:19:46 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writing DB stats cinder:SELECT=1 {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:19:46 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writing DB stats cinder:UPDATE=1 {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:20:16 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:20:16 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Updating volume stats {{(pid=76534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:20:16 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:20:16 devstack sudo[84465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:20:16 devstack sudo[84465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:20:17 devstack sudo[84465]: pam_unix(sudo:session): session closed for user root Jul 07 22:20:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:20:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:20:17 devstack sudo[84479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:20:17 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:20:18 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root Jul 07 22:20:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.745s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:20:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:20:18 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:20:18 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:20:18 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Jul 07 22:20:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.775s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:20:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:20:18 devstack sudo[84550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:20:18 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:20:19 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root Jul 07 22:20:19 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.793s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:20:19 devstack cinder-volume[76534]: DEBUG cinder.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Notifying Schedulers of capabilities ... {{(pid=76534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:20:19 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager._thread_info {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:20:19 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread count: 6 {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:20:19 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread info: [<_MainThread(MainThread, started 134460633686144)>, , , , , ] {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:21:16 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:21:16 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Updating volume stats {{(pid=76534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 22:21:16 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:21:16 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 22:21:16 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:21:17 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Jul 07 22:21:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.764s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:21:17 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:21:17 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:21:17 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:21:18 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Jul 07 22:21:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:21:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:21:18 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 22:21:18 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:21:18 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Jul 07 22:21:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.723s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:21:18 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:21:18 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 22:21:18 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:21:19 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Jul 07 22:21:19 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-e3e67843-92c4-441c-a353-612d341980bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:21:19 devstack cinder-volume[76534]: DEBUG cinder.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Notifying Schedulers of capabilities ... {{(pid=76534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:21:19 devstack cinder-volume[76534]: DEBUG oslo_service.periodic_task [None req-e3e67843-92c4-441c-a353-612d341980bc None None] Running periodic task VolumeManager._thread_info {{(pid=76534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:21:19 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread count: 6 {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:21:19 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-e3e67843-92c4-441c-a353-612d341980bc None None] thread info: [<_MainThread(MainThread, started 134460633686144)>, , , , , ] {{(pid=76534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:21:46 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:22:12 devstack cinder-volume[76380]: INFO oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Caught SIGTERM, stopping children Jul 07 22:22:12 devstack cinder-volume[76380]: DEBUG oslo_concurrency.lockutils [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Acquiring lock "singleton_lock" {{(pid=76380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:22:12 devstack cinder-volume[76380]: DEBUG oslo_concurrency.lockutils [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Acquired lock "singleton_lock" {{(pid=76380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:22:12 devstack cinder-volume[76380]: DEBUG oslo_concurrency.lockutils [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Releasing lock "singleton_lock" {{(pid=76380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:22:12 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Stop services. {{(pid=76380) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 22:22:12 devstack cinder-volume[76380]: DEBUG oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Killing children. {{(pid=76380) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 22:22:12 devstack cinder-volume[76380]: INFO oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Waiting on 1 children to exit Jul 07 22:22:13 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Acquiring lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:22:13 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Acquired lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:22:13 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Releasing lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:22:13 devstack cinder-volume[76534]: WARNING amqp [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 22:22:13 devstack cinder-volume[76534]: WARNING amqp [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 22:22:13 devstack cinder-volume[76380]: INFO oslo_service.backend._eventlet.service [None req-40dbe378-db13-46e8-bd58-55478edf0306 None None] Child 76534 exited with status 0 Jul 07 22:22:14 devstack cinder-volume[86822]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 22:22:14 devstack cinder-volume[86822]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:22:14 devstack cinder-volume[86822]: we strongly recommend against using it for new projects. Jul 07 22:22:14 devstack cinder-volume[86822]: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:22:14 devstack cinder-volume[86822]: framework. For more detail see Jul 07 22:22:14 devstack cinder-volume[86822]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:22:14 devstack cinder-volume[86822]: import eventlet # noqa Jul 07 22:22:16 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:22:16 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:22:16 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:22:17 devstack cinder-volume[86822]: INFO dbcounter [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Registered counter for database cinder Jul 07 22:22:17 devstack cinder-volume[86822]: DEBUG oslo_db.sqlalchemy.engines [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:22:17 devstack cinder-volume[86822]: DEBUG dbcounter [-] [86822] Writer thread running {{(pid=86822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:22:17 devstack cinder-volume[86822]: INFO cinder.rpc [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 22:22:17 devstack cinder-volume[86822]: INFO cinder.rpc [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 22:22:17 devstack cinder-volume[86822]: DEBUG oslo_db.sqlalchemy.engines [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:22:17 devstack cinder-volume[86822]: INFO cinder.volume.manager [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Determined volume DB was empty at startup. Jul 07 22:22:17 devstack cinder-volume[86822]: DEBUG cinder.volume.manager [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86822) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 22:22:17 devstack cinder-volume[86822]: INFO cinder.volume.manager [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 22:22:17 devstack cinder-volume[86822]: WARNING stevedore.named [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 22:22:17 devstack cinder-volume[86822]: WARNING castellan.key_manager [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:22:17 devstack cinder-volume[86822]: WARNING cinder.keymgr.conf_key_mgr [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:22:17 devstack cinder-volume[86822]: INFO cinder.volume.manager [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 22:22:17 devstack cinder-volume[86822]: DEBUG oslo_db.sqlalchemy.engines [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:22:18 devstack cinder-volume[86822]: INFO oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Starting 1 workers Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Started child 87036 {{(pid=86822) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Full set of CONF: {{(pid=86822) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] ******************************************************************************** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Configuration options gathered from: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] ================================================================================ {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] allow_availability_zone_fallback = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] allow_compression_on_image_upload = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[87036]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] allowed_direct_url_schemes = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] api_rate_limit = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] auth_strategy = keystone {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_availability_zone = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_host = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_stats_polling_interval = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backup_api_class = cinder.backup.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backup_name_template = backup-%s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backup_use_same_host = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backup_use_temp_snapshot = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] chap_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] chap_username = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_internal_tenant_project_id = 6b81fcbd8df7458cbda17f5455a307c9 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_internal_tenant_user_id = a38980985fef4cc98666938982c96bf8 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cluster = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] compression_format = gzip {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] compute_api_class = cinder.compute.nova.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] config_dir = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] config_source = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] control_exchange = openstack {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] debug = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] default_availability_zone = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] default_group_type = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] default_volume_type = QuobyteHD {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] disk_geometry = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] driver_client_cert = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] driver_client_cert_key = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] driver_data_namespace = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] driver_ssl_cert_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] driver_ssl_cert_verify = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] driver_use_ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] enable_new_services = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] enable_unsupported_driver = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] enabled_backends = ['QuobyteHD'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] enforce_multipath_for_image_xfer = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] filter_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_api_insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_api_ssl_compression = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_ca_certificates_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_catalog_info = image:glance:publicURL {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_num_retries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance_request_timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] goodness_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] graceful_shutdown_timeout = 5 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] group_api_class = cinder.group.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] host = devstack {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_compress_on_upload = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_conversion_address_space_limit = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_conversion_cpu_limit = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_conversion_disable = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_upload_use_cinder_backend = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_upload_use_internal_tenant = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_volume_cache_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_volume_cache_max_count = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] image_volume_cache_max_size_gb = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] init_host_max_objects_retrieval = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] instance_format = [instance: %(uuid)s] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] iscsi_target_flags = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] iscsi_write_cache = on {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] iser_helper = tgtadm {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] iser_ip_address = 192.168.122.205 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] iser_port = 3260 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_color = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_config_append = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_dir = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_options = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_rotate_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_rotate_interval_type = days {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] log_rotation_type = none {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] max_age = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] max_logfile_count = 30 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] max_logfile_size_mb = 200 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] max_over_subscription_ratio = 20.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] message_reap_interval = 86400 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] message_ttl = 2592000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] migration_create_volume_timeout_secs = 300 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] monkey_patch = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] monkey_patch_modules = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] my_ip = 192.168.122.205 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] no_snapshot_gb_quota = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] num_iser_scan_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] num_shell_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] num_volume_device_scan_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] nvmeof_conn_info_version = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] nvmet_ns_id = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] nvmet_port_id = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] osapi_max_limit = 1000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] osapi_volume_ext_list = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] osapi_volume_listen_port = 8776 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] osapi_volume_use_ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] osapi_volume_workers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] per_volume_size_limit = -1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] periodic_fuzzy_delay = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] periodic_interval = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] public_endpoint = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] publish_errors = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] quota_backup_gigabytes = 1000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] quota_backups = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] quota_gigabytes = 1000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] quota_groups = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] quota_snapshots = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] quota_volumes = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] rate_limit_burst = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] rate_limit_except_level = CRITICAL {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] rate_limit_interval = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] reinit_driver_count = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] replication_device = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] report_discard_supported = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] report_interval = 120 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] reservation_clean_interval = 86400 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] reservation_expire = 86400 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] reserved_image_namespaces = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] reserved_percentage = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] rpc_response_timeout = 120 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] run_external_periodic_tasks = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] scst_target_driver = iscsi {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] scst_target_iqn_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_down_time = 720 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] shell_completion = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] snapshot_name_template = snapshot-%s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] state_path = /opt/stack/data/cinder {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] storage_availability_zone = nova {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] storage_protocol = iSCSI {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] syslog_log_facility = LOG_USER {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] target_helper = lioadm {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] target_ip_address = 192.168.122.205 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] target_port = 3260 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] target_protocol = iscsi {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] target_secondary_ip_addresses = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] trace_flags = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] transport_url = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] until_refresh = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] use_chap_auth = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] use_default_quota_class = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] use_journal = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] use_json = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] use_multipath_for_image_xfer = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] use_stderr = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] use_syslog = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] verify_glance_signatures = enabled {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_api_class = cinder.volume.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_backend_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_clear = zero {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_clear_ionice = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_clear_size = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_copy_bps_limit = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_dd_blocksize = 1M {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_name_template = volume-%s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_service_inithost_offload = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volume_usage_audit_period = month {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] zoning_mode = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_concurrency.disable_process_locking = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.auth_section = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.auth_type = password {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.auth_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.cache = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.include_service_catalog = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.interface = public {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_password = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[87036]: INFO cinder.volume.manager [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcache_username = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.region_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.service_type = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.remotefs [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87036) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.backend = dogpile.cache.null {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.backend_argument = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.backend_expiration_time = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.config_prefix = cache.oslo {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.debug_cache_backend = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.enable_retry_client = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.enable_socket_keepalive = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.expiration_time = 600 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.hashclient_retry_attempts = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.memcache_dead_retry = 300 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.memcache_pool_maxsize = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.memcache_sasl_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.proxies = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.redis_db = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.redis_server = localhost:6379 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.retry_attempts = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.retry_delay = 0.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.socket_keepalive_count = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.socket_keepalive_idle = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.socket_keepalive_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.socket_timeout = 1.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.tls_allowed_ciphers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.tls_cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.tls_certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.tls_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.tls_keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cache.username = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] coordination.backend_url = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.asyncio_connection = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.asyncio_slave_connection = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.backend = sqlalchemy {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.connection = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.connection_debug = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.connection_parameters = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.connection_recycle_time = 3600 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.connection_trace = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.db_inc_retry_interval = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.db_max_retries = 20 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.db_max_retry_interval = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.db_retry_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.max_overflow = 50 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.max_pool_size = 5 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.max_retries = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.mysql_wsrep_sync_wait = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.pool_timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.retry_interval = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.slave_connection = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.sqlite_synchronous = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.synchronous_reader = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] database.use_db_reconnect = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.connection_string = messaging:// {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.es_doc_type = notification {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.es_scroll_size = 10000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.es_scroll_time = 2m {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.filter_error_trace = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.hmac_keys = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.sentinel_service_name = mymaster {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.socket_timeout = 0.1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.trace_requests = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler.trace_sqlalchemy = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler_jaeger.process_tags = {} {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler_jaeger.service_name_prefix = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] profiler_otlp.service_name_prefix = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.enforce_new_defaults = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.enforce_scope = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.policy_default_rule = default {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.policy_file = policy.yaml {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] privsep_osbrick.group = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] privsep_osbrick.helper_command = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] privsep_osbrick.user = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_sys_admin.group = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_sys_admin.helper_command = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] cinder_sys_admin.user = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.auth_section = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.auth_type = password {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.collect_timing = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.send_service_user_token = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] service_user.timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.auth_section = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.auth_type = password {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.collect_timing = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.region_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] glance.timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.backend_availability_zone = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.chap_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.chap_username = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.disk_geometry = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.driver_client_cert = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.driver_client_cert_key = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.driver_data_namespace = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.driver_use_ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.extra_capabilities = {} {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.filter_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.goodness_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.iscsi_target_flags = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.iscsi_write_cache = on {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.iser_helper = tgtadm {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.iser_port = 3260 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_host = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_login = admin {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_mount_options = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_private_key = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_share_path = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.num_shell_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.quobyte_volume_url = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.replication_device = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.report_discard_supported = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.reserved_percentage = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.target_helper = tgtadm {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.target_port = 3260 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.target_protocol = iscsi {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.trace_flags = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.unique_fqdn_network = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.use_chap_auth = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volume_backend_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volume_clear = zero {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volume_clear_ionice = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volume_clear_size = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_reports.file_event_handler = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_reports.log_dir = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.backend_availability_zone = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.backend_host = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.chap_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.chap_username = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.chiscsi_conf = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.disk_geometry = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.driver_client_cert = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.driver_data_namespace = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.driver_use_ssl = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.extra_capabilities = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.filter_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.goodness_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.iser_helper = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.iser_ip_address = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.iser_port = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.iser_target_prefix = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_host = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_login = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_mount_options = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_private_key = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_share_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_ssh_port = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.num_shell_tries = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.nvmet_port_id = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.replication_device = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.report_discard_supported = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.reserved_percentage = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.scst_target_driver = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.storage_protocol = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.target_helper = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.target_ip_address = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.target_port = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.target_prefix = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.target_protocol = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.trace_flags = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.use_chap_auth = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volume_clear = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volume_clear_size = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] QuobyteHD.volumes_dir = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_notifications.driver = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_notifications.retry = -1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87036) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 22:22:18 devstack cinder-volume[87036]: WARNING cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 22:22:18 devstack cinder-volume[87036]: WARNING cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 22:22:18 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Running cmd (subprocess): mount.quobyte {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] key_manager.fixed_key = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.barbican_api_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.barbican_endpoint = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.barbican_endpoint_type = public {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.barbican_region_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.collect_timing = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.number_of_retries = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.retry_delay = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.send_service_user_token = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.verify_ssl = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican.verify_ssl_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.auth_section = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.auth_type = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.collect_timing = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] barbican_service_user.timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.approle_role_id = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.approle_secret_id = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.kv_mountpoint = secret {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.kv_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.kv_version = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.namespace = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.root_token_id = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.ssl_ca_crt_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.timeout = 60.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.use_ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:18 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] ******************************************************************************** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 22:22:18 devstack quobyte-client[87041]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 22:22:18 devstack quobyte-client[87041]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 22:22:18 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:18 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:22:18 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:22:18 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:22:18 devstack cinder-volume[87036]: INFO cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc ... Jul 07 22:22:18 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 -c /etc/quobyte/client-cinder.cfg {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:18 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 -c /etc/quobyte/client-cinder.cfg Jul 07 22:22:18 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:22:19 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Jul 07 22:22:19 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.831s {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:19 devstack cinder-volume[87036]: INFO cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc succeeded Jul 07 22:22:19 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:22:19 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.844s {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:22:19 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:19 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:22:19 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:22:19 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Jul 07 22:22:19 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.697s {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:19 devstack cinder-volume[87036]: INFO cinder.volume.driver [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 22:22:19 devstack cinder-volume[87036]: DEBUG cinder.volume.driver [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7212715148926, 'free_capacity_gb': 1775.7212715148926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87036) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 22:22:19 devstack cinder-volume[87036]: DEBUG oslo_db.sqlalchemy.engines [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG dbcounter [-] [87036] Writer thread running {{(pid=87036) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG cinder.db.api [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Building query based on filter {{(pid=87036) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG cinder.image.image_utils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87036) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 22:22:20 devstack cinder-volume[87036]: INFO cinder.keymgr.migration [None req-3540e3ef-d0f4-45e2-9f0f-0c4694db3059 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:22:20 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:20 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:22:20 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:22:21 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.132s {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG cinder.manager [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Notifying Schedulers of capabilities ... {{(pid=87036) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:22:21 devstack cinder-volume[87036]: INFO cinder.volume.manager [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Driver initialization completed successfully. Jul 07 22:22:21 devstack cinder-volume[87036]: INFO cinder.manager [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Initiating service 3 cleanup Jul 07 22:22:21 devstack cinder-volume[87036]: INFO cinder.manager [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Service 3 cleanup completed. Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG cinder.service [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Creating RPC server for service cinder-volume {{(pid=87036) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG cinder.service [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87036) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 22:22:21 devstack cinder-volume[87036]: INFO cinder.volume.manager [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:22:21 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:21 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:22:21 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:22:22 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Jul 07 22:22:22 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.851s {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:22 devstack cinder-volume[87036]: INFO cinder.volume.manager [None req-11c39f77-da62-466a-9313-405d2c9d9340 None None] Driver post RPC initialization completed successfully. Jul 07 22:22:24 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-93f2700e-5692-4113-97de-26f67237bb07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:22:24 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-93f2700e-5692-4113-97de-26f67237bb07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:22:24 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-93f2700e-5692-4113-97de-26f67237bb07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:22:24 devstack cinder-volume[87036]: DEBUG cinder.volume.drivers.quobyte [None req-93f2700e-5692-4113-97de-26f67237bb07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:22:24 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-93f2700e-5692-4113-97de-26f67237bb07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:22:24 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-93f2700e-5692-4113-97de-26f67237bb07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:24 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:22:24 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:22:25 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Jul 07 22:22:25 devstack cinder-volume[87036]: DEBUG oslo_concurrency.processutils [None req-93f2700e-5692-4113-97de-26f67237bb07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.672s {{(pid=87036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:25 devstack cinder-volume[87036]: DEBUG cinder.manager [None req-93f2700e-5692-4113-97de-26f67237bb07 None None] Notifying Schedulers of capabilities ... {{(pid=87036) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:22:27 devstack cinder-volume[86822]: INFO oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Caught SIGTERM, stopping children Jul 07 22:22:27 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Acquiring lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:22:27 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Acquired lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:22:27 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Releasing lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:22:27 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Stop services. {{(pid=86822) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 22:22:27 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Killing children. {{(pid=86822) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 22:22:27 devstack cinder-volume[86822]: INFO oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Waiting on 1 children to exit Jul 07 22:22:29 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Acquiring lock "singleton_lock" {{(pid=87036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:22:29 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Acquired lock "singleton_lock" {{(pid=87036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:22:29 devstack cinder-volume[87036]: DEBUG oslo_concurrency.lockutils [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Releasing lock "singleton_lock" {{(pid=87036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:22:29 devstack cinder-volume[87036]: WARNING amqp [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 22:22:29 devstack cinder-volume[86822]: INFO oslo_service.backend._eventlet.service [None req-52a718d5-cf1f-4968-b43a-ca1abe54013e None None] Child 87036 exited with status 0 Jul 07 22:22:30 devstack cinder-volume[87351]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 22:22:30 devstack cinder-volume[87351]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:22:30 devstack cinder-volume[87351]: we strongly recommend against using it for new projects. Jul 07 22:22:30 devstack cinder-volume[87351]: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:22:30 devstack cinder-volume[87351]: framework. For more detail see Jul 07 22:22:30 devstack cinder-volume[87351]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:22:30 devstack cinder-volume[87351]: import eventlet # noqa Jul 07 22:22:32 devstack cinder-volume[87351]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 22:22:32 devstack cinder-volume[87351]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 22:22:32 devstack cinder-volume[87351]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 22:22:33 devstack cinder-volume[87351]: INFO dbcounter [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Registered counter for database cinder Jul 07 22:22:33 devstack cinder-volume[87351]: DEBUG oslo_db.sqlalchemy.engines [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG dbcounter [-] [87351] Writer thread running {{(pid=87351) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:22:34 devstack cinder-volume[87351]: INFO cinder.rpc [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 22:22:34 devstack cinder-volume[87351]: INFO cinder.rpc [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_db.sqlalchemy.engines [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:22:34 devstack cinder-volume[87351]: INFO cinder.volume.manager [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Determined volume DB was empty at startup. Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG cinder.volume.manager [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87351) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 22:22:34 devstack cinder-volume[87351]: WARNING stevedore.named [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 22:22:34 devstack cinder-volume[87351]: WARNING castellan.key_manager [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:22:34 devstack cinder-volume[87351]: WARNING cinder.keymgr.conf_key_mgr [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 22:22:34 devstack cinder-volume[87351]: INFO cinder.volume.manager [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_db.sqlalchemy.engines [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:22:34 devstack cinder-volume[87351]: INFO oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Starting 1 workers Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Started child 87612 {{(pid=87351) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Full set of CONF: {{(pid=87351) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] ******************************************************************************** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] Configuration options gathered from: {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] ================================================================================ {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] allow_availability_zone_fallback = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] allow_compression_on_image_upload = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] allowed_direct_url_schemes = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] api_rate_limit = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] auth_strategy = keystone {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87612]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_availability_zone = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_host = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_stats_polling_interval = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backup_api_class = cinder.backup.api.API {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backup_name_template = backup-%s {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backup_use_same_host = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backup_use_temp_snapshot = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] chap_password = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] chap_username = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_internal_tenant_project_id = 6b81fcbd8df7458cbda17f5455a307c9 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_internal_tenant_user_id = a38980985fef4cc98666938982c96bf8 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cluster = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] compression_format = gzip {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] compute_api_class = cinder.compute.nova.API {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] config_dir = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] config_source = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] control_exchange = openstack {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] debug = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] default_availability_zone = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] default_group_type = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] default_volume_type = QuobyteHD {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] disk_geometry = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] driver_client_cert = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] driver_client_cert_key = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] driver_data_namespace = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] driver_ssl_cert_path = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] driver_ssl_cert_verify = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] driver_use_ssl = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] enable_new_services = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] enable_unsupported_driver = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] enabled_backends = ['QuobyteHD'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] enforce_multipath_for_image_xfer = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] filter_function = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_api_insecure = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_api_ssl_compression = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_ca_certificates_file = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_catalog_info = image:glance:publicURL {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_certfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_keyfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_num_retries = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance_request_timeout = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] goodness_function = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] graceful_shutdown_timeout = 5 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] group_api_class = cinder.group.api.API {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] host = devstack {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_compress_on_upload = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_conversion_address_space_limit = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_conversion_cpu_limit = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_conversion_disable = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_upload_use_cinder_backend = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_upload_use_internal_tenant = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_volume_cache_enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_volume_cache_max_count = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] image_volume_cache_max_size_gb = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] init_host_max_objects_retrieval = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] instance_format = [instance: %(uuid)s] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] iscsi_target_flags = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] iscsi_write_cache = on {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] iser_helper = tgtadm {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] iser_ip_address = 192.168.122.205 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] iser_port = 3260 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_color = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_config_append = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_dir = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_file = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_options = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_rotate_interval = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_rotate_interval_type = days {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] log_rotation_type = none {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] max_age = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] max_logfile_count = 30 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] max_logfile_size_mb = 200 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] max_over_subscription_ratio = 20.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] message_reap_interval = 86400 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] message_ttl = 2592000 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] migration_create_volume_timeout_secs = 300 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] monkey_patch = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] monkey_patch_modules = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] my_ip = 192.168.122.205 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] no_snapshot_gb_quota = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] num_iser_scan_tries = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] num_shell_tries = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] num_volume_device_scan_tries = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] nvmeof_conn_info_version = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] nvmet_ns_id = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] nvmet_port_id = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] osapi_max_limit = 1000 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] osapi_volume_ext_list = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] osapi_volume_listen_port = 8776 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] osapi_volume_use_ssl = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] osapi_volume_workers = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] per_volume_size_limit = -1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] periodic_fuzzy_delay = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] periodic_interval = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] public_endpoint = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] publish_errors = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] quota_backup_gigabytes = 1000 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] quota_backups = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] quota_gigabytes = 1000 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] quota_groups = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] quota_snapshots = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] quota_volumes = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] rate_limit_burst = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] rate_limit_except_level = CRITICAL {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] rate_limit_interval = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] reinit_driver_count = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] replication_device = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] report_discard_supported = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] report_interval = 120 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] reservation_clean_interval = 86400 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] reservation_expire = 86400 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] reserved_image_namespaces = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] reserved_percentage = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] rpc_response_timeout = 120 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] run_external_periodic_tasks = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] scst_target_driver = iscsi {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] scst_target_iqn_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_down_time = 720 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] shell_completion = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] snapshot_name_template = snapshot-%s {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] split_loggers = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] state_path = /opt/stack/data/cinder {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] storage_availability_zone = nova {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] storage_protocol = iSCSI {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] syslog_log_facility = LOG_USER {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] target_helper = lioadm {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] target_ip_address = 192.168.122.205 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] target_port = 3260 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] target_protocol = iscsi {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] target_secondary_ip_addresses = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] trace_flags = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] transport_url = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] until_refresh = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] use_chap_auth = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] use_default_quota_class = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] use_journal = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] use_json = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] use_multipath_for_image_xfer = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] use_stderr = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] use_syslog = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] verify_glance_signatures = enabled {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_api_class = cinder.volume.api.API {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_backend_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_clear = zero {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_clear_ionice = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_clear_size = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_copy_bps_limit = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_dd_blocksize = 1M {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_name_template = volume-%s {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_service_inithost_offload = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volume_usage_audit_period = month {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] zoning_mode = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_concurrency.disable_process_locking = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87612) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.auth_section = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.auth_type = password {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.auth_version = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.cache = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.certfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.include_service_catalog = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.insecure = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.interface = public {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.keyfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_password = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcache_username = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.region_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.service_type = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.backend = dogpile.cache.null {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.backend_argument = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.backend_expiration_time = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.config_prefix = cache.oslo {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.debug_cache_backend = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.enable_retry_client = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.enable_socket_keepalive = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.expiration_time = 600 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.hashclient_retry_attempts = 2 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.memcache_dead_retry = 300 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.memcache_pool_maxsize = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.memcache_sasl_enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.password = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.proxies = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.redis_db = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.redis_server = localhost:6379 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.retry_attempts = 2 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.retry_delay = 0.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.socket_keepalive_count = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.socket_keepalive_idle = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.socket_keepalive_interval = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.socket_timeout = 1.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.tls_allowed_ciphers = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.tls_cafile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.tls_certfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.tls_enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.tls_keyfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cache.username = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] coordination.backend_url = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.asyncio_connection = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.asyncio_slave_connection = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.backend = sqlalchemy {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.connection = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.connection_debug = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.connection_parameters = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.connection_recycle_time = 3600 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.connection_trace = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.db_inc_retry_interval = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.db_max_retries = 20 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.db_max_retry_interval = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.db_retry_interval = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.max_overflow = 50 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.max_pool_size = 5 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.max_retries = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.mysql_wsrep_sync_wait = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.pool_timeout = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.retry_interval = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.slave_connection = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.sqlite_synchronous = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.synchronous_reader = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] database.use_db_reconnect = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.connection_string = messaging:// {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.es_doc_type = notification {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.es_scroll_size = 10000 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.es_scroll_time = 2m {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.filter_error_trace = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.hmac_keys = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.sentinel_service_name = mymaster {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.socket_timeout = 0.1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.trace_requests = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler.trace_sqlalchemy = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler_jaeger.process_tags = {} {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler_jaeger.service_name_prefix = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] profiler_otlp.service_name_prefix = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.enforce_new_defaults = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.enforce_scope = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.policy_default_rule = default {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.policy_file = policy.yaml {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] privsep_osbrick.group = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] privsep_osbrick.helper_command = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] privsep_osbrick.user = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_sys_admin.group = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_sys_admin.helper_command = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] cinder_sys_admin.user = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.auth_section = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.auth_type = password {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.cafile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.certfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.collect_timing = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.insecure = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.keyfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.send_service_user_token = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.split_loggers = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] service_user.timeout = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.auth_section = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.auth_type = password {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.certfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.collect_timing = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.insecure = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.keyfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.region_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.split_loggers = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] glance.timeout = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.backend_availability_zone = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.chap_password = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.chap_username = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.disk_geometry = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.driver_client_cert = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.driver_client_cert_key = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.driver_data_namespace = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.driver_use_ssl = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.extra_capabilities = {} {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.filter_function = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.goodness_function = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:34 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.iscsi_target_flags = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.iscsi_write_cache = on {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.iser_helper = tgtadm {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.iser_port = 3260 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_host = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_login = admin {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_mount_options = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_password = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_private_key = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_share_path = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.num_shell_tries = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.quobyte_volume_url = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.replication_device = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.report_discard_supported = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.reserved_percentage = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.target_helper = tgtadm {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.target_port = 3260 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.target_protocol = iscsi {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.trace_flags = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.unique_fqdn_network = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.use_chap_auth = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volume_backend_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volume_clear = zero {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volume_clear_ionice = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volume_clear_size = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_reports.file_event_handler = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_reports.log_dir = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.backend_availability_zone = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.backend_host = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.chap_password = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.chap_username = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.chiscsi_conf = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.disk_geometry = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.driver_client_cert = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.driver_data_namespace = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.driver_use_ssl = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.extra_capabilities = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.filter_function = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.goodness_function = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.iser_helper = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.iser_ip_address = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.iser_port = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.iser_target_prefix = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_host = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_login = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_mount_options = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_password = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_private_key = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_share_path = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_ssh_port = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack quobyte-client[87626]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.num_shell_tries = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.nvmet_port_id = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack quobyte-client[87626]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.replication_device = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.report_discard_supported = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.reserved_percentage = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.scst_target_driver = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.storage_protocol = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.target_helper = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.target_ip_address = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.target_port = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.target_prefix = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.target_protocol = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.trace_flags = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.use_chap_auth = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volume_clear = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volume_clear_size = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] QuobyteHD.volumes_dir = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.ssl = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87612) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 22:22:35 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_notifications.driver = [] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_notifications.retry = -1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Running cmd (subprocess): mount.quobyte {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] key_manager.fixed_key = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.barbican_api_version = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.barbican_endpoint = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.barbican_endpoint_type = public {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.barbican_region_name = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.cafile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.certfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.collect_timing = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.insecure = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.keyfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.number_of_retries = 60 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.retry_delay = 1 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.send_service_user_token = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.split_loggers = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.timeout = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.verify_ssl = True {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican.verify_ssl_path = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.auth_section = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.auth_type = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.cafile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.certfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.collect_timing = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.insecure = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.keyfile = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.split_loggers = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] barbican_service_user.timeout = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.approle_role_id = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.approle_secret_id = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.kv_mountpoint = secret {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.kv_path = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.kv_version = 2 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.namespace = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.root_token_id = **** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.ssl_ca_crt_file = None {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.timeout = 60.0 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.use_ssl = False {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 22:22:35 devstack cinder-volume[87351]: DEBUG oslo_service.backend._eventlet.service [None req-1d463a4c-4bb3-44eb-9260-ff7aaadfc3a2 None None] ******************************************************************************** {{(pid=87351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] CMD "mount.quobyte" returned: 1 in 0.123s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:35 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:22:35 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:22:35 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.837s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:35 devstack cinder-volume[87612]: INFO cinder.volume.driver [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 22:22:35 devstack cinder-volume[87612]: DEBUG cinder.volume.driver [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7212715148926, 'free_capacity_gb': 1775.7212715148926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87612) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG oslo_db.sqlalchemy.engines [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writer thread running {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG cinder.db.api [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Building query based on filter {{(pid=87612) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87612) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:36 devstack cinder-volume[87612]: INFO cinder.keymgr.migration [None req-636e1989-60f1-49cc-8841-bff7daaa626a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 22:22:36 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:22:36 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:22:36 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.809s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:36 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:22:36 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Driver initialization completed successfully. Jul 07 22:22:36 devstack cinder-volume[87612]: INFO cinder.manager [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Initiating service 3 cleanup Jul 07 22:22:37 devstack cinder-volume[87612]: INFO cinder.manager [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Service 3 cleanup completed. Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG cinder.service [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Creating RPC server for service cinder-volume {{(pid=87612) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG cinder.service [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87612) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 22:22:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:22:37 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:22:37 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:22:37 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Jul 07 22:22:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.616s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:22:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cf94bb27-caf0-4770-8a09-addcf5d68151 None None] Driver post RPC initialization completed successfully. Jul 07 22:22:44 devstack cinder-volume[87351]: DEBUG dbcounter [-] [87351] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87351) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:22:47 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=3 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:22:47 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:22:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:22:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 6 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:22:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:23:37 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Flow 'volume_create_manager' (5509acfd-e49f-4763-b780-833db8f6dc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eb4af7-6e2f-442c-9979-db3bcb1c1e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eb4af7-6e2f-442c-9979-db3bcb1c1e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1840872089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1be2de-a678-4bbd-8d81-092958e96b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0e9e095859f4a52b56bfe80af3f81ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:23:38Z,use_quota=True,user_id='a18575e63e1e4a6d94fcce1015fc4494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9409d750-de4b-49b5-b1ed-d92501e86de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9409d750-de4b-49b5-b1ed-d92501e86de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3a32f2-f297-40db-baf6-0c5d3817bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3a32f2-f297-40db-baf6-0c5d3817bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1be2de-a678-4bbd-8d81-092958e96b43', 'volume_name': 'volume-4a1be2de-a678-4bbd-8d81-092958e96b43', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a6839b-0ba7-43ad-bf5a-7e4e2cb6507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a6839b-0ba7-43ad-bf5a-7e4e2cb6507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c6baf0-e785-4539-83b9-772da42d5637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:23:38 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Volume 4a1be2de-a678-4bbd-8d81-092958e96b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1be2de-a678-4bbd-8d81-092958e96b43', 'volume_size': 1} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1840872089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1be2de-a678-4bbd-8d81-092958e96b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0e9e095859f4a52b56bfe80af3f81ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:23:38Z,use_quota=True,user_id='a18575e63e1e4a6d94fcce1015fc4494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Creating volume 4a1be2de-a678-4bbd-8d81-092958e96b43 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:23:38 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:23:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:23:38 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 1073741824 Jul 07 22:23:38 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:23:39 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Jul 07 22:23:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 1073741824" returned: 0 in 1.165s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:23:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:23:39 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 Jul 07 22:23:39 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:23:40 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Jul 07 22:23:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43" returned: 0 in 0.949s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:23:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:23:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:23:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c6baf0-e785-4539-83b9-772da42d5637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1be2de-a678-4bbd-8d81-092958e96b43', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:23:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c398ee57-9c9d-4b8e-80d1-03aab807f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:23:40 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Volume volume-4a1be2de-a678-4bbd-8d81-092958e96b43 (4a1be2de-a678-4bbd-8d81-092958e96b43): created successfully Jul 07 22:23:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c398ee57-9c9d-4b8e-80d1-03aab807f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:23:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Flow 'volume_create_manager' (5509acfd-e49f-4763-b780-833db8f6dc7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:23:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a895c32f-4611-4408-adec-acf67e8ed354 tempest-TaggedAttachmentsTest-1197531486 None] Created volume successfully. Jul 07 22:23:50 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:23:50 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:23:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:23:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:23:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:23:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:23:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:23:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:23:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:23:55 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:23:55 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:23:56 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Jul 07 22:23:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.176s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:23:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:23:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:23:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 6 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:23:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Flow 'volume_create_manager' (ab3ebcd9-877b-4782-ac58-37b7ed85958d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4a4702-f74e-4205-b9c1-657504514560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4a4702-f74e-4205-b9c1-657504514560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-888931484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95af541-254f-422f-9dd3-742f6821f646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8900fb17ca4d98808a69edf42f706e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:24:14Z,use_quota=True,user_id='bbeb356abca74cc4bf6ff1bab98ee3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54fbeb4-44aa-415a-97fb-cad175d0fb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54fbeb4-44aa-415a-97fb-cad175d0fb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd4db48-d366-4664-82d7-eb44a3799330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd4db48-d366-4664-82d7-eb44a3799330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95af541-254f-422f-9dd3-742f6821f646', 'volume_name': 'volume-a95af541-254f-422f-9dd3-742f6821f646', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75964bb5-a533-4826-a613-5dedfa41382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75964bb5-a533-4826-a613-5dedfa41382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68cf24e-7ddd-4582-bf7b-8f43323fd802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:14 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Volume a95af541-254f-422f-9dd3-742f6821f646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95af541-254f-422f-9dd3-742f6821f646', 'volume_size': 1} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-888931484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95af541-254f-422f-9dd3-742f6821f646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8900fb17ca4d98808a69edf42f706e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:24:14Z,use_quota=True,user_id='bbeb356abca74cc4bf6ff1bab98ee3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Creating volume a95af541-254f-422f-9dd3-742f6821f646 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:24:14 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:24:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:14 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 1073741824 Jul 07 22:24:14 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:16 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 1073741824" returned: 0 in 2.401s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:17 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 Jul 07 22:24:17 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Flow 'volume_create_manager' (d157dd48-c98d-456c-94df-b70c78c99b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4260ee0-3454-4061-a00c-266b7d0b59c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4260ee0-3454-4061-a00c-266b7d0b59c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2094911409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332656fd-3fde-446b-8bfb-c84009c1fd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30d8d5209a4536a2ada3dedf2afd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:24:18Z,use_quota=True,user_id='5896009b3a5a4220856311cc5a118a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c70a0a-4088-4a8e-9ded-29425406ece2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c70a0a-4088-4a8e-9ded-29425406ece2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0900f239-0138-4f45-93cb-b527b032eb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0900f239-0138-4f45-93cb-b527b032eb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332656fd-3fde-446b-8bfb-c84009c1fd49', 'volume_name': 'volume-332656fd-3fde-446b-8bfb-c84009c1fd49', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd136f75-7b46-4aae-992b-1f79cddf657f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd136f75-7b46-4aae-992b-1f79cddf657f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6657d1e1-af3b-4423-b6ad-d47310557e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:18 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Volume 332656fd-3fde-446b-8bfb-c84009c1fd49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332656fd-3fde-446b-8bfb-c84009c1fd49', 'volume_size': 1} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:24:18 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646" returned: 0 in 1.640s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] <== create_volume: return (4182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.195s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.113s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2094911409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332656fd-3fde-446b-8bfb-c84009c1fd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30d8d5209a4536a2ada3dedf2afd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:24:18Z,use_quota=True,user_id='5896009b3a5a4220856311cc5a118a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Creating volume 332656fd-3fde-446b-8bfb-c84009c1fd49 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:24:18 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68cf24e-7ddd-4582-bf7b-8f43323fd802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95af541-254f-422f-9dd3-742f6821f646', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1939ca9-8544-4e8f-8535-e3edbfdd6772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:18 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 1073741824 Jul 07 22:24:18 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:18 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Volume volume-a95af541-254f-422f-9dd3-742f6821f646 (a95af541-254f-422f-9dd3-742f6821f646): created successfully Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1939ca9-8544-4e8f-8535-e3edbfdd6772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Flow 'volume_create_manager' (ab3ebcd9-877b-4782-ac58-37b7ed85958d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:24:18 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2b093ea0-d837-4bdc-8692-a72cbad015fb tempest-DeleteServersTestJSON-1810530310 None] Created volume successfully. Jul 07 22:24:20 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 1073741824" returned: 0 in 1.730s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:20 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 Jul 07 22:24:20 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:22 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49" returned: 0 in 1.718s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] <== create_volume: return (3549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:24:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.552s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:24:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6657d1e1-af3b-4423-b6ad-d47310557e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332656fd-3fde-446b-8bfb-c84009c1fd49', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d780204-11f3-443b-a7cd-ad30e72b82dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:24:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Volume volume-332656fd-3fde-446b-8bfb-c84009c1fd49 (332656fd-3fde-446b-8bfb-c84009c1fd49): created successfully Jul 07 22:24:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d780204-11f3-443b-a7cd-ad30e72b82dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:24:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Flow 'volume_create_manager' (d157dd48-c98d-456c-94df-b70c78c99b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:24:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-10880cae-d520-49b6-8a6f-937a09218fb3 tempest-VolumesAdminNegativeTest-1515824723 None] Created volume successfully. Jul 07 22:24:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Acquiring lock "cinder-332656fd-3fde-446b-8bfb-c84009c1fd49-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:24:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Lock "cinder-332656fd-3fde-446b-8bfb-c84009c1fd49-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:24:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Acquiring lock "cinder-quobyte-332656fd-3fde-446b-8bfb-c84009c1fd49" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:24:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Lock "cinder-quobyte-332656fd-3fde-446b-8bfb-c84009c1fd49" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:24:25 devstack cinder-volume[87612]: INFO oslo.privsep.daemon [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc7jjofv6/privsep.sock'] Jul 07 22:24:25 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc7jjofv6/privsep.sock Jul 07 22:24:25 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 22:24:26 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 22:24:28 devstack cinder-volume[87612]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 22:24:28 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:28 devstack cinder-volume[87612]: INFO oslo.privsep.daemon [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Spawned new privsep daemon via rootwrap Jul 07 22:24:28 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Accepted privsep connection to /tmp/tmpc7jjofv6/privsep.sock {{(pid=87612) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 22:24:28 devstack cinder-volume[87612]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 22:24:28 devstack cinder-volume[87612]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 22:24:28 devstack cinder-volume[87612]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 22:24:28 devstack cinder-volume[87612]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88825 Jul 07 22:24:28 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[626ce5a8-2e57-4ab7-946d-84770475326e]: (2,) {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:24:28 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c9b34e-2647-463c-a189-00a28f3a4429]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:24:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:29 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 Jul 07 22:24:29 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:30 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49" returned: 0 in 2.026s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:30 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49 Jul 07 22:24:30 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:31 devstack cinder-volume[87612]: WARNING py.warnings [req-dbf71c79-6101-462f-8009-0fb7fce7a4ee req-d2e5c3c4-268e-44e3-87f9-31505d5fed8d tempest-DeleteServersTestJSON-1810530310 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 07 22:24:31 devstack cinder-volume[87612]: .first() Jul 07 22:24:31 devstack cinder-volume[87612]: Jul 07 22:24:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-dbf71c79-6101-462f-8009-0fb7fce7a4ee req-d2e5c3c4-268e-44e3-87f9-31505d5fed8d tempest-DeleteServersTestJSON-1810530310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:24:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-dbf71c79-6101-462f-8009-0fb7fce7a4ee req-d2e5c3c4-268e-44e3-87f9-31505d5fed8d tempest-DeleteServersTestJSON-1810530310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:24:31 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac73bc1-df1f-4521-a5b1-69a705c5ecce]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:24:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-dbf71c79-6101-462f-8009-0fb7fce7a4ee req-d2e5c3c4-268e-44e3-87f9-31505d5fed8d tempest-DeleteServersTestJSON-1810530310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:32 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 Jul 07 22:24:32 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:32 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-332656fd-3fde-446b-8bfb-c84009c1fd49" returned: 0 in 1.469s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Lock "cinder-quobyte-332656fd-3fde-446b-8bfb-c84009c1fd49" released by "delete_volume" :: held 6.747s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:24:32 devstack cinder-volume[87612]: WARNING cinder.quota [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:24:32 devstack cinder-volume[87612]: WARNING cinder.quota [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Created reservations ['1645b065-b732-4243-959c-9d58eb59819e', 'bd6bca59-cf60-4ccb-a5c6-a6180912748c', '3d0bd392-7204-4bed-9e6b-298eee48998e', '25eb423b-2ef7-42cd-a943-ad97dafe32ec'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:24:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:32 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:24:32 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:33 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-dbf71c79-6101-462f-8009-0fb7fce7a4ee req-d2e5c3c4-268e-44e3-87f9-31505d5fed8d tempest-DeleteServersTestJSON-1810530310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646" returned: 0 in 1.290s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-dbf71c79-6101-462f-8009-0fb7fce7a4ee req-d2e5c3c4-268e-44e3-87f9-31505d5fed8d tempest-DeleteServersTestJSON-1810530310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.348s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:24:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-dbf71c79-6101-462f-8009-0fb7fce7a4ee req-d2e5c3c4-268e-44e3-87f9-31505d5fed8d tempest-DeleteServersTestJSON-1810530310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-a95af541-254f-422f-9dd3-742f6821f646', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34a5b9f1-85ca-4167-865a-d0bc483843f4', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:24:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-dbf71c79-6101-462f-8009-0fb7fce7a4ee req-d2e5c3c4-268e-44e3-87f9-31505d5fed8d tempest-DeleteServersTestJSON-1810530310 None] attachment_update completed successfully. Jul 07 22:24:34 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.489s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:34 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:24:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Deleted volume successfully. Jul 07 22:24:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2c4cd5fd-aef4-473b-a4ea-21e3dbf46f5a tempest-VolumesAdminNegativeTest-1515824723 None] Lock "cinder-332656fd-3fde-446b-8bfb-c84009c1fd49-delete_volume" released by "delete_volume" :: held 8.927s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:24:46 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-931894e4-8ff0-45aa-8fe7-456d6db9c6cb req-b591cd8d-784d-4b44-97cf-00c9d6639656 tempest-DeleteServersTestJSON-1810530310 None] Terminate volume connection completed successfully. Jul 07 22:24:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-931894e4-8ff0-45aa-8fe7-456d6db9c6cb req-b591cd8d-784d-4b44-97cf-00c9d6639656 tempest-DeleteServersTestJSON-1810530310 None] Deleting attachment 34a5b9f1-85ca-4167-865a-d0bc483843f4. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:24:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Acquiring lock "cinder-a95af541-254f-422f-9dd3-742f6821f646-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:24:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Lock "cinder-a95af541-254f-422f-9dd3-742f6821f646-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:24:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Acquiring lock "cinder-quobyte-a95af541-254f-422f-9dd3-742f6821f646" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:24:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Lock "cinder-quobyte-a95af541-254f-422f-9dd3-742f6821f646" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:24:51 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fba070-8d8e-4e5f-a387-d83ffae42d08]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:24:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:51 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 Jul 07 22:24:51 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:51 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646" returned: 0 in 0.842s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:51 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646 Jul 07 22:24:51 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:52 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a95af541-254f-422f-9dd3-742f6821f646" returned: 0 in 0.722s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Lock "cinder-quobyte-a95af541-254f-422f-9dd3-742f6821f646" released by "delete_volume" :: held 1.624s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Created reservations ['c7458389-8c3d-4da3-9136-e6156e543040', 'fcdbbae8-4a69-440f-870b-33b8b5e3a009', '3563f12d-fb43-4463-bb22-33cb733bb361', '5669b194-30a8-46cc-9402-10d4adea84f7'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:24:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:52 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:24:52 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:53 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.750s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:53 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:24:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Deleted volume successfully. Jul 07 22:24:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4440715-9f6f-4c7b-8fcb-be2bb0a1d3cc tempest-DeleteServersTestJSON-1810530310 None] Lock "cinder-a95af541-254f-422f-9dd3-742f6821f646-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:24:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:24:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:24:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:24:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:24:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:24:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:24:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:24:55 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:24:55 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:24:56 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Jul 07 22:24:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.900s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:24:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:25:02 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:25:03 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=23,cinder:SELECT=19,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Flow 'volume_create_manager' (c0698a69-4521-49de-8442-31baa430839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57689841-d542-456b-97b3-68c18c552de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57689841-d542-456b-97b3-68c18c552de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-901973931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e530e9-0cbb-4b38-9e85-511e642be0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02442bfe4e3c42c984a8a76e9c36cf0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:25:27Z,use_quota=True,user_id='c075c22719a34a278d1d3b23071f0994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24aea67-9ef0-4e04-b0cf-06ac539ef11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24aea67-9ef0-4e04-b0cf-06ac539ef11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65142ecd-31af-4768-bf9f-e86729db635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65142ecd-31af-4768-bf9f-e86729db635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e530e9-0cbb-4b38-9e85-511e642be0b4', 'volume_name': 'volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1ac93b-e17a-455f-83e0-f2a9e3d9eebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1ac93b-e17a-455f-83e0-f2a9e3d9eebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf704f5e-1c18-4359-a13a-5271c147d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:27 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Volume b7e530e9-0cbb-4b38-9e85-511e642be0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4', 'volume_size': 1} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-901973931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e530e9-0cbb-4b38-9e85-511e642be0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02442bfe4e3c42c984a8a76e9c36cf0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:25:27Z,use_quota=True,user_id='c075c22719a34a278d1d3b23071f0994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Creating volume b7e530e9-0cbb-4b38-9e85-511e642be0b4 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:25:27 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:25:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:27 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 1073741824 Jul 07 22:25:27 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:28 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 1073741824" returned: 0 in 1.259s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:28 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 Jul 07 22:25:28 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-19576be5-f126-4d99-bd67-4cbe05c1c040 req-ad09a849-86eb-4732-8df9-aef3c247c9b3 tempest-TaggedAttachmentsTest-1197531486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:25:29 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4" returned: 0 in 0.805s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-19576be5-f126-4d99-bd67-4cbe05c1c040 req-ad09a849-86eb-4732-8df9-aef3c247c9b3 tempest-TaggedAttachmentsTest-1197531486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.646s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf704f5e-1c18-4359-a13a-5271c147d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd02642e-d80c-4879-a49b-cfb4be322d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[482abf3d-f414-4be5-aacc-86c29a2ac06a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19576be5-f126-4d99-bd67-4cbe05c1c040 req-ad09a849-86eb-4732-8df9-aef3c247c9b3 tempest-TaggedAttachmentsTest-1197531486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:29 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Volume volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 (b7e530e9-0cbb-4b38-9e85-511e642be0b4): created successfully Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd02642e-d80c-4879-a49b-cfb4be322d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Flow 'volume_create_manager' (c0698a69-4521-49de-8442-31baa430839d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:25:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f01a88c9-de4d-48c8-9699-3c45ff2759fa tempest-ServerActionsTestOtherA-626911697 None] Created volume successfully. Jul 07 22:25:29 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 Jul 07 22:25:29 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:30 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19576be5-f126-4d99-bd67-4cbe05c1c040 req-ad09a849-86eb-4732-8df9-aef3c247c9b3 tempest-TaggedAttachmentsTest-1197531486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43" returned: 0 in 0.956s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-19576be5-f126-4d99-bd67-4cbe05c1c040 req-ad09a849-86eb-4732-8df9-aef3c247c9b3 tempest-TaggedAttachmentsTest-1197531486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:25:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-19576be5-f126-4d99-bd67-4cbe05c1c040 req-ad09a849-86eb-4732-8df9-aef3c247c9b3 tempest-TaggedAttachmentsTest-1197531486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-4a1be2de-a678-4bbd-8d81-092958e96b43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d0a8fcd-b4fc-4f3e-af0c-5ed038aa5495', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:25:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-19576be5-f126-4d99-bd67-4cbe05c1c040 req-ad09a849-86eb-4732-8df9-aef3c247c9b3 tempest-TaggedAttachmentsTest-1197531486 None] attachment_update completed successfully. Jul 07 22:25:40 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:25:40 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:25:43 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-9ff4295c-791a-4430-9328-e6fc6d41de88 req-83397121-2c19-4c53-8620-ba2929eac867 tempest-TaggedAttachmentsTest-1197531486 None] Terminate volume connection completed successfully. Jul 07 22:25:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-9ff4295c-791a-4430-9328-e6fc6d41de88 req-83397121-2c19-4c53-8620-ba2929eac867 tempest-TaggedAttachmentsTest-1197531486 None] Deleting attachment 9d0a8fcd-b4fc-4f3e-af0c-5ed038aa5495. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:25:53 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:25:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:25:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:25:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:25:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:25:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:25:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:25:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:55 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:25:55 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Flow 'volume_create_manager' (f3639b11-9226-4f96-80bf-ac437e4866be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e328281f-9358-4479-badd-0e9be233916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e328281f-9358-4479-badd-0e9be233916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1202342250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f057d904-bda1-4fe8-b13d-8e2f06ff672c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd82c5005f1458e96ba0946493ed76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:25:57Z,use_quota=True,user_id='3f1d0d09819f4409b992fb2e1f764045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8de5656-e759-4e5a-9602-0db6bd47c641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8de5656-e759-4e5a-9602-0db6bd47c641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be0b31d-8b23-4a6d-9848-32348978abe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be0b31d-8b23-4a6d-9848-32348978abe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f057d904-bda1-4fe8-b13d-8e2f06ff672c', 'volume_name': 'volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4e627d-c568-4889-91ac-13e2a9000c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4e627d-c568-4889-91ac-13e2a9000c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b78af63-083f-48c1-b181-b88f66dced51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:25:57 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Volume f057d904-bda1-4fe8-b13d-8e2f06ff672c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c', 'volume_size': 1} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1202342250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f057d904-bda1-4fe8-b13d-8e2f06ff672c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd82c5005f1458e96ba0946493ed76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:25:57Z,use_quota=True,user_id='3f1d0d09819f4409b992fb2e1f764045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Creating volume f057d904-bda1-4fe8-b13d-8e2f06ff672c {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:25:57 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:57 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.951s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:25:57 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c 1073741824 Jul 07 22:25:57 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 8 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:25:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:25:59 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jul 07 22:25:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c 1073741824" returned: 0 in 1.868s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:25:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:25:59 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c Jul 07 22:25:59 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:02 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c" returned: 0 in 2.480s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] <== create_volume: return (4461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:26:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.469s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b78af63-083f-48c1-b181-b88f66dced51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37335d3d-0afb-4214-b37e-4f1b2b720b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:02 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Volume volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c (f057d904-bda1-4fe8-b13d-8e2f06ff672c): created successfully Jul 07 22:26:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37335d3d-0afb-4214-b37e-4f1b2b720b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Flow 'volume_create_manager' (f3639b11-9226-4f96-80bf-ac437e4866be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:26:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-40892ff9-cd1c-45b6-b24b-a4958b1dde98 tempest-ServerRescueNegativeTestJSON-1553200306 None] Created volume successfully. Jul 07 22:26:12 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:26:12 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:26:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Acquiring lock "cinder-4a1be2de-a678-4bbd-8d81-092958e96b43-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:26:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Lock "cinder-4a1be2de-a678-4bbd-8d81-092958e96b43-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:26:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Acquiring lock "cinder-quobyte-4a1be2de-a678-4bbd-8d81-092958e96b43" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:26:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Lock "cinder-quobyte-4a1be2de-a678-4bbd-8d81-092958e96b43" acquired by "delete_volume" :: waited 0.013s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:26:13 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[117fd0c2-1cdd-482a-902c-d2662e711dcc]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:26:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:13 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 Jul 07 22:26:13 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:14 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43" returned: 0 in 0.897s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:14 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43 Jul 07 22:26:14 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:14 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Flow 'volume_create_manager' (3c134c40-3487-4f65-a4de-54bd1e657bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4560a40f-1e31-47a3-a27d-8fee11d64df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4560a40f-1e31-47a3-a27d-8fee11d64df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1948390045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a70673-21ad-4a90-922b-fda28071440d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb434649834cbd819dd726e0db243e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:26:15Z,use_quota=True,user_id='c61f5485fd9041859fc803292a1b1a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4810b684-7951-423c-a92a-eee23adce325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4810b684-7951-423c-a92a-eee23adce325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e36452-be42-4556-8c04-e173f5dafdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e36452-be42-4556-8c04-e173f5dafdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a70673-21ad-4a90-922b-fda28071440d', 'volume_name': 'volume-84a70673-21ad-4a90-922b-fda28071440d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7409def5-fd6b-4ab1-a941-2426c3507ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7409def5-fd6b-4ab1-a941-2426c3507ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9608070-4127-45b4-a2f1-151d7e5e5bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Volume 84a70673-21ad-4a90-922b-fda28071440d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a70673-21ad-4a90-922b-fda28071440d', 'volume_size': 1} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1948390045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a70673-21ad-4a90-922b-fda28071440d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb434649834cbd819dd726e0db243e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:26:15Z,use_quota=True,user_id='c61f5485fd9041859fc803292a1b1a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Creating volume 84a70673-21ad-4a90-922b-fda28071440d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:26:15 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:15 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d 1073741824 Jul 07 22:26:15 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:15 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4a1be2de-a678-4bbd-8d81-092958e96b43" returned: 0 in 1.080s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Lock "cinder-quobyte-4a1be2de-a678-4bbd-8d81-092958e96b43" released by "delete_volume" :: held 2.026s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Created reservations ['6086bde3-7d99-451e-9d34-65f417ddcf8e', '4254c4ce-39ab-4ea2-91c7-c5395c260a76', '3db15154-9dce-4e4b-b290-df6e9991b20b', '9f87e864-6cff-4aff-836e-3840c8d467ae'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:15 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:26:15 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:16 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d 1073741824" returned: 0 in 1.278s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:16 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d Jul 07 22:26:16 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:16 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.961s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:16 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:26:16 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Deleted volume successfully. Jul 07 22:26:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66ccabac-ec44-4ba5-8725-7365537b5b18 tempest-TaggedAttachmentsTest-1197531486 None] Lock "cinder-4a1be2de-a678-4bbd-8d81-092958e96b43-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:26:17 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d" returned: 0 in 0.974s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:26:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.337s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9608070-4127-45b4-a2f1-151d7e5e5bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a70673-21ad-4a90-922b-fda28071440d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff47d4-93c3-49ff-b1dd-bc0e392f2825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:17 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Volume volume-84a70673-21ad-4a90-922b-fda28071440d (84a70673-21ad-4a90-922b-fda28071440d): created successfully Jul 07 22:26:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff47d4-93c3-49ff-b1dd-bc0e392f2825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Flow 'volume_create_manager' (3c134c40-3487-4f65-a4de-54bd1e657bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:26:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f3eb0c45-34d5-45d2-ba41-6b7a58665c58 tempest-ServersNegativeTestJSON-1838898430 None] Created volume successfully. Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Flow 'volume_create_manager' (2240eb72-abff-453c-8a1f-7ffe159a79f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0158fc51-8369-4807-8a69-d07f99dcf059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0158fc51-8369-4807-8a69-d07f99dcf059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-199239369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bbfdc6-6134-4b09-9e18-23f272e7ef82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb434649834cbd819dd726e0db243e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:26:20Z,use_quota=True,user_id='c61f5485fd9041859fc803292a1b1a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56e1581-3c78-4227-9cb2-743087aeba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56e1581-3c78-4227-9cb2-743087aeba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec625950-65f4-4f82-90fc-bfbd97bb854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec625950-65f4-4f82-90fc-bfbd97bb854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7bbfdc6-6134-4b09-9e18-23f272e7ef82', 'volume_name': 'volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce800d27-81d6-4765-8d53-8fe3068e549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce800d27-81d6-4765-8d53-8fe3068e549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32cf16b-aa17-4620-9c5f-8a4b237aadc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:20 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Volume a7bbfdc6-6134-4b09-9e18-23f272e7ef82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82', 'volume_size': 1} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-199239369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bbfdc6-6134-4b09-9e18-23f272e7ef82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb434649834cbd819dd726e0db243e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:26:20Z,use_quota=True,user_id='c61f5485fd9041859fc803292a1b1a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Creating volume a7bbfdc6-6134-4b09-9e18-23f272e7ef82 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:26:20 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:26:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:20 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 1073741824 Jul 07 22:26:20 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:22 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 1073741824" returned: 0 in 1.509s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:22 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 Jul 07 22:26:22 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:22 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82" returned: 0 in 0.872s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] <== create_volume: return (2466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:26:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32cf16b-aa17-4620-9c5f-8a4b237aadc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f76405f-183f-42f6-931a-e1eb9bdc0b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:26:23 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Volume volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 (a7bbfdc6-6134-4b09-9e18-23f272e7ef82): created successfully Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f76405f-183f-42f6-931a-e1eb9bdc0b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Flow 'volume_create_manager' (2240eb72-abff-453c-8a1f-7ffe159a79f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:26:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ae32361a-ab84-4679-bb99-6a2c555fa9fc tempest-ServersNegativeTestJSON-1838898430 None] Created volume successfully. Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Acquiring lock "cinder-f057d904-bda1-4fe8-b13d-8e2f06ff672c-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "cinder-f057d904-bda1-4fe8-b13d-8e2f06ff672c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Acquiring lock "cinder-quobyte-f057d904-bda1-4fe8-b13d-8e2f06ff672c" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "cinder-quobyte-f057d904-bda1-4fe8-b13d-8e2f06ff672c" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a45200-5cd3-49f3-b3db-f17e6b2f3a4b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:26:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:24 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c Jul 07 22:26:24 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "cinder-a7bbfdc6-6134-4b09-9e18-23f272e7ef82-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:26:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Lock "cinder-a7bbfdc6-6134-4b09-9e18-23f272e7ef82-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:26:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "cinder-quobyte-a7bbfdc6-6134-4b09-9e18-23f272e7ef82" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:26:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Lock "cinder-quobyte-a7bbfdc6-6134-4b09-9e18-23f272e7ef82" acquired by "delete_volume" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:26:24 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dced43d-e08c-4a16-b58c-026eda5aa82b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:26:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:24 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 Jul 07 22:26:24 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:25 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c" returned: 0 in 1.443s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:25 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c Jul 07 22:26:25 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:26 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82" returned: 0 in 1.699s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:26 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82 Jul 07 22:26:26 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:26 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f057d904-bda1-4fe8-b13d-8e2f06ff672c" returned: 0 in 1.272s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "cinder-quobyte-f057d904-bda1-4fe8-b13d-8e2f06ff672c" released by "delete_volume" :: held 2.808s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Created reservations ['2a5b48ae-e70f-4cf6-99a8-550f1cecd7e4', 'ac3487b0-e921-42de-ba46-21b8f3d716f7', '4c50f913-0994-4d4b-85dc-595e20f273de', 'b91c1d0d-20b6-4bb6-94bd-af8cbaa77954'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:26 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:26:26 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:27 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a7bbfdc6-6134-4b09-9e18-23f272e7ef82" returned: 0 in 0.975s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Lock "cinder-quobyte-a7bbfdc6-6134-4b09-9e18-23f272e7ef82" released by "delete_volume" :: held 2.776s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Created reservations ['73109d45-e151-4ea8-abb5-343a60e94bf7', '8fa3600c-9844-4356-80a4-08e32d03b4aa', '21da8e15-8d1d-41cc-9b1a-84f29fbfd749', 'b67151a7-2992-403f-b9b3-c60069e9bd76'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:27 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:26:27 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "cinder-84a70673-21ad-4a90-922b-fda28071440d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:26:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Lock "cinder-84a70673-21ad-4a90-922b-fda28071440d-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:26:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "cinder-quobyte-84a70673-21ad-4a90-922b-fda28071440d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:26:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Lock "cinder-quobyte-84a70673-21ad-4a90-922b-fda28071440d" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:26:28 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a90ac-6d59-44f8-bbe6-d1e71622160d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:26:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:28 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.457s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:28 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:26:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Deleted volume successfully. Jul 07 22:26:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4892d0ee-ea8b-4f90-ae50-f618bb6070bd tempest-ServerRescueNegativeTestJSON-1553200306 None] Lock "cinder-f057d904-bda1-4fe8-b13d-8e2f06ff672c-delete_volume" released by "delete_volume" :: held 4.615s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:26:28 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d Jul 07 22:26:28 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:29 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.995s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:29 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:26:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Deleted volume successfully. Jul 07 22:26:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-56f4a754-8f38-4cc7-b301-3b726501a217 tempest-ServersNegativeTestJSON-1838898430 None] Lock "cinder-a7bbfdc6-6134-4b09-9e18-23f272e7ef82-delete_volume" released by "delete_volume" :: held 5.158s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:26:30 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d" returned: 0 in 2.335s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-98704496-933b-47c3-93f4-2db2bf6400a3 req-134e11be-5eb3-499b-8a58-b672b323461f tempest-ServerActionsTestOtherA-626911697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-98704496-933b-47c3-93f4-2db2bf6400a3 req-134e11be-5eb3-499b-8a58-b672b323461f tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:30 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d Jul 07 22:26:30 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb9259f-31e4-47bf-962e-0c16e495c7f1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:26:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-98704496-933b-47c3-93f4-2db2bf6400a3 req-134e11be-5eb3-499b-8a58-b672b323461f tempest-ServerActionsTestOtherA-626911697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:30 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 Jul 07 22:26:30 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:31 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-84a70673-21ad-4a90-922b-fda28071440d" returned: 0 in 1.450s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Lock "cinder-quobyte-84a70673-21ad-4a90-922b-fda28071440d" released by "delete_volume" :: held 3.879s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Created reservations ['045e8de2-937d-4fb5-93f8-922bbfd5a901', '75824edd-c7d6-47f5-bc82-dd63b29dd3b0', 'eea38d60-62e2-4396-849a-36b11fba7e03', '10842ca4-632d-4bd2-be1c-24549d6b6613'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:26:32 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-98704496-933b-47c3-93f4-2db2bf6400a3 req-134e11be-5eb3-499b-8a58-b672b323461f tempest-ServerActionsTestOtherA-626911697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4" returned: 0 in 1.814s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-98704496-933b-47c3-93f4-2db2bf6400a3 req-134e11be-5eb3-499b-8a58-b672b323461f tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.854s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:32 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:26:32 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-98704496-933b-47c3-93f4-2db2bf6400a3 req-134e11be-5eb3-499b-8a58-b672b323461f tempest-ServerActionsTestOtherA-626911697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0acf6fc0-4c1d-4826-8036-56c3c89a64f5', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:26:32 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-98704496-933b-47c3-93f4-2db2bf6400a3 req-134e11be-5eb3-499b-8a58-b672b323461f tempest-ServerActionsTestOtherA-626911697 None] attachment_update completed successfully. Jul 07 22:26:33 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.162s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:33 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:26:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Deleted volume successfully. Jul 07 22:26:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fd4bbb00-9309-4e48-8f58-de8d5f9eb5d8 tempest-ServersNegativeTestJSON-1838898430 None] Lock "cinder-84a70673-21ad-4a90-922b-fda28071440d-delete_volume" released by "delete_volume" :: held 5.590s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:26:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-e0801b90-f6b2-4a26-80d8-028c9dc1a9f6 tempest-ServerActionsTestOtherA-626911697 None] Terminate volume connection completed successfully. Jul 07 22:26:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-e0801b90-f6b2-4a26-80d8-028c9dc1a9f6 tempest-ServerActionsTestOtherA-626911697 None] Deleting attachment 0acf6fc0-4c1d-4826-8036-56c3c89a64f5. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:26:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-6c015734-e3a9-4670-b039-eaff182406b8 tempest-ServerActionsTestOtherA-626911697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-6c015734-e3a9-4670-b039-eaff182406b8 tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:44 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d22f89-b56a-485a-a8dc-ecab1e9ff4e6]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:26:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-6c015734-e3a9-4670-b039-eaff182406b8 tempest-ServerActionsTestOtherA-626911697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:44 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 Jul 07 22:26:44 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:45 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-6c015734-e3a9-4670-b039-eaff182406b8 tempest-ServerActionsTestOtherA-626911697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4" returned: 0 in 1.056s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-6c015734-e3a9-4670-b039-eaff182406b8 tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.082s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-6c015734-e3a9-4670-b039-eaff182406b8 tempest-ServerActionsTestOtherA-626911697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0f1b30d-946b-4630-8153-5621de6b508b', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:26:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-70afe7bb-64a0-4b9d-9c1b-31d797c69284 req-6c015734-e3a9-4670-b039-eaff182406b8 tempest-ServerActionsTestOtherA-626911697 None] attachment_update completed successfully. Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=36,cinder:INSERT=12,cinder:UPDATE=42,cinder:DELETE=4 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=41,cinder:SELECT=37,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:26:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:26:55 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:26:55 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:26:56 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Jul 07 22:26:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.980s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:26:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:27:21 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-b900dc48-455a-4898-9c7c-708d406189bd req-81e98a82-cd0d-4381-826e-ee0df9c3a00a tempest-ServerActionsTestOtherA-626911697 None] Terminate volume connection completed successfully. Jul 07 22:27:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b900dc48-455a-4898-9c7c-708d406189bd req-81e98a82-cd0d-4381-826e-ee0df9c3a00a tempest-ServerActionsTestOtherA-626911697 None] Deleting attachment a0f1b30d-946b-4630-8153-5621de6b508b. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:27:31 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:27:31 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:27:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Acquiring lock "cinder-b7e530e9-0cbb-4b38-9e85-511e642be0b4-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:27:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Lock "cinder-b7e530e9-0cbb-4b38-9e85-511e642be0b4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:27:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Acquiring lock "cinder-quobyte-b7e530e9-0cbb-4b38-9e85-511e642be0b4" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:27:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Lock "cinder-quobyte-b7e530e9-0cbb-4b38-9e85-511e642be0b4" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:27:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac0e8ba-6aa0-4d92-9fb6-b4034528f055]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:27:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:36 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 Jul 07 22:27:36 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:38 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4" returned: 0 in 1.796s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:38 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4 Jul 07 22:27:38 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:39 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b7e530e9-0cbb-4b38-9e85-511e642be0b4" returned: 0 in 1.280s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Lock "cinder-quobyte-b7e530e9-0cbb-4b38-9e85-511e642be0b4" released by "delete_volume" :: held 3.152s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Created reservations ['34aa3d64-f577-4cf7-9f68-5cf29ccd9007', '52e44713-f539-4f4d-b077-0fa3f3e1a691', 'a6fd897a-c936-488b-acf8-e93086a1bea1', '7e70d953-eb60-4d7f-b6b9-dd915fec9167'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:27:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:39 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:27:39 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:41 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.287s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:41 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:27:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Deleted volume successfully. Jul 07 22:27:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b1fdf50d-618d-4f93-872e-be4cf42624fe tempest-ServerActionsTestOtherA-626911697 None] Lock "cinder-b7e530e9-0cbb-4b38-9e85-511e642be0b4-delete_volume" released by "delete_volume" :: held 4.787s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Flow 'volume_create_manager' (83d04535-56f1-401e-a68b-c174c4277bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbdd75d-55fb-4541-b86e-baf6ae650be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbdd75d-55fb-4541-b86e-baf6ae650be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1080058458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10c9eb6-8da9-49e8-85b1-7577533f3c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb04e177052f4d0eaf067cf87fe6e715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:27:43Z,use_quota=True,user_id='d24bf6f5a95d4261834024e8c785121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (debc2529-ed14-4208-993b-ff8657d0f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (debc2529-ed14-4208-993b-ff8657d0f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c170d77-eea3-435b-bf2b-6419342ffebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c170d77-eea3-435b-bf2b-6419342ffebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10c9eb6-8da9-49e8-85b1-7577533f3c47', 'volume_name': 'volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b111cb66-5538-4e5c-ba03-ae1ee9656d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b111cb66-5538-4e5c-ba03-ae1ee9656d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e6944f-a940-44e5-b117-7fe439359442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:43 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Volume e10c9eb6-8da9-49e8-85b1-7577533f3c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47', 'volume_size': 1} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1080058458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10c9eb6-8da9-49e8-85b1-7577533f3c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb04e177052f4d0eaf067cf87fe6e715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:27:43Z,use_quota=True,user_id='d24bf6f5a95d4261834024e8c785121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Creating volume e10c9eb6-8da9-49e8-85b1-7577533f3c47 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:27:43 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:27:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:43 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 1073741824 Jul 07 22:27:43 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:44 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 1073741824" returned: 0 in 1.814s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:45 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 Jul 07 22:27:45 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:45 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47" returned: 0 in 0.850s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] <== create_volume: return (2760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:27:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.764s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:27:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e6944f-a940-44e5-b117-7fe439359442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f208c6f-2dbb-4f61-9ea2-e01e39afb975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:45 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Volume volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 (e10c9eb6-8da9-49e8-85b1-7577533f3c47): created successfully Jul 07 22:27:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f208c6f-2dbb-4f61-9ea2-e01e39afb975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Flow 'volume_create_manager' (83d04535-56f1-401e-a68b-c174c4277bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:27:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e1922a8d-4b3f-45e4-ada8-56730f8642fc tempest-AttachVolumeNegativeTest-27436603 None] Created volume successfully. Jul 07 22:27:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-5878fb08-68f8-4486-8195-86faecc9dcdf req-15d69d17-b557-4511-8ea5-313ffa72d55b tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:27:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-5878fb08-68f8-4486-8195-86faecc9dcdf req-15d69d17-b557-4511-8ea5-313ffa72d55b tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:27:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[88258b84-0c40-47ce-8d61-c831c3fb13c1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:27:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-5878fb08-68f8-4486-8195-86faecc9dcdf req-15d69d17-b557-4511-8ea5-313ffa72d55b tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:49 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 Jul 07 22:27:49 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:50 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-5878fb08-68f8-4486-8195-86faecc9dcdf req-15d69d17-b557-4511-8ea5-313ffa72d55b tempest-AttachVolumeNegativeTest-27436603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47" returned: 0 in 0.800s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-5878fb08-68f8-4486-8195-86faecc9dcdf req-15d69d17-b557-4511-8ea5-313ffa72d55b tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:27:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-5878fb08-68f8-4486-8195-86faecc9dcdf req-15d69d17-b557-4511-8ea5-313ffa72d55b tempest-AttachVolumeNegativeTest-27436603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '380ab94d-e912-4a95-ad5a-96250b16444e', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:27:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-5878fb08-68f8-4486-8195-86faecc9dcdf req-15d69d17-b557-4511-8ea5-313ffa72d55b tempest-AttachVolumeNegativeTest-27436603 None] attachment_update completed successfully. Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Flow 'volume_create_manager' (da37bfad-d3a7-40d1-b996-da85d05885fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df5eb8e-00b2-4fee-b449-c728ca06ae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df5eb8e-00b2-4fee-b449-c728ca06ae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-656584573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33e7079-862c-40a2-93ab-e1f328637f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9b3476083420fb355c27d6a3c44ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:27:56Z,use_quota=True,user_id='7a2d9dee20204c94b622ef9acdb8814a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7170577f-27f0-4175-92d3-cdff2d4c0b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7170577f-27f0-4175-92d3-cdff2d4c0b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc52ecf-c138-4535-9103-8a934db8fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc52ecf-c138-4535-9103-8a934db8fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33e7079-862c-40a2-93ab-e1f328637f62', 'volume_name': 'volume-c33e7079-862c-40a2-93ab-e1f328637f62', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80b1c73-6f2f-4ed3-883d-ea6afc6d536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80b1c73-6f2f-4ed3-883d-ea6afc6d536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f4ee86-ce82-44c1-9a38-bf3dedf0ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:55 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Volume c33e7079-862c-40a2-93ab-e1f328637f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33e7079-862c-40a2-93ab-e1f328637f62', 'volume_size': 1} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-656584573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33e7079-862c-40a2-93ab-e1f328637f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9b3476083420fb355c27d6a3c44ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:27:56Z,use_quota=True,user_id='7a2d9dee20204c94b622ef9acdb8814a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Creating volume c33e7079-862c-40a2-93ab-e1f328637f62 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:27:55 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:27:55 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 1073741824 Jul 07 22:27:55 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:27:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:55 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:27:55 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:56 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.938s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:27:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:27:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 8 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:27:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:27:56 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 1073741824" returned: 0 in 1.087s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:27:56 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 Jul 07 22:27:56 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:27:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e49f2a79-aef5-46b9-bb13-e37a9e22da52 tempest-BackendsCapabilitiesAdminTestsJSON-630090859 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7212715148926, 'free_capacity_gb': 1775.7212715148926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87612) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 22:27:57 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 07 22:27:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62" returned: 0 in 0.751s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:27:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:27:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:27:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f4ee86-ce82-44c1-9a38-bf3dedf0ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33e7079-862c-40a2-93ab-e1f328637f62', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e83f76-04dc-4c39-b85b-82b17d83b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:27:57 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Volume volume-c33e7079-862c-40a2-93ab-e1f328637f62 (c33e7079-862c-40a2-93ab-e1f328637f62): created successfully Jul 07 22:27:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e83f76-04dc-4c39-b85b-82b17d83b8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:27:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Flow 'volume_create_manager' (da37bfad-d3a7-40d1-b996-da85d05885fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:27:57 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a8755089-1d0b-489c-9fb2-c3d2283b14f0 tempest-AttachVolumeTestJSON-1685907325 None] Created volume successfully. Jul 07 22:27:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2d175254-8526-4b93-9070-effa001b7d80 tempest-BackendsCapabilitiesAdminTestsJSON-630090859 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7212715148926, 'free_capacity_gb': 1775.7212715148926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87612) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 22:27:59 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Flow 'volume_create_manager' (1f7742b1-a15d-4a97-9279-1467bcf0e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb8424b-f276-4d06-9683-6fdbe83b58ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb8424b-f276-4d06-9683-6fdbe83b58ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1739753162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed51eedf-27cb-4f52-9eff-8bd980c3257a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc46c78e3564234a4cbb279aae98d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:00Z,use_quota=True,user_id='4284e8839261434dac95a45ea54ee45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4beec1e0-da85-4555-b405-37a8954b7df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4beec1e0-da85-4555-b405-37a8954b7df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4da11cf-9a9e-4ed1-92f5-226cc64c4a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4da11cf-9a9e-4ed1-92f5-226cc64c4a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed51eedf-27cb-4f52-9eff-8bd980c3257a', 'volume_name': 'volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f02b20d-c517-4fdb-a1b0-f4b637d7103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f02b20d-c517-4fdb-a1b0-f4b637d7103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdda09a6-b983-4a5a-81b2-eb1148673ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:00 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Volume ed51eedf-27cb-4f52-9eff-8bd980c3257a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a', 'volume_size': 1} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1739753162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed51eedf-27cb-4f52-9eff-8bd980c3257a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc46c78e3564234a4cbb279aae98d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:00Z,use_quota=True,user_id='4284e8839261434dac95a45ea54ee45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Creating volume ed51eedf-27cb-4f52-9eff-8bd980c3257a {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:28:00 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:28:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:00 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a 1073741824 Jul 07 22:28:00 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:01 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a 1073741824" returned: 0 in 1.070s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:01 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a Jul 07 22:28:01 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:01 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a" returned: 0 in 0.732s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:28:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdda09a6-b983-4a5a-81b2-eb1148673ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2324c6-a127-4492-973a-060d50d72e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:02 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Volume volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a (ed51eedf-27cb-4f52-9eff-8bd980c3257a): created successfully Jul 07 22:28:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2324c6-a127-4492-973a-060d50d72e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Flow 'volume_create_manager' (1f7742b1-a15d-4a97-9279-1467bcf0e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-57aebe58-1a97-4d5f-9a03-0a0ab77a9b15 tempest-AttachVolumeShelveTestJSON-179054744 None] Created volume successfully. Jul 07 22:28:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-459bb787-30e5-41e5-92e2-947c6b3d0b55 req-e1141db1-afcd-4530-ade1-5d4cffdcba6f tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-459bb787-30e5-41e5-92e2-947c6b3d0b55 req-e1141db1-afcd-4530-ade1-5d4cffdcba6f tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b16756-b289-467c-af9d-655535f61ff3]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:28:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-459bb787-30e5-41e5-92e2-947c6b3d0b55 req-e1141db1-afcd-4530-ade1-5d4cffdcba6f tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:02 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 Jul 07 22:28:02 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:02 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-459bb787-30e5-41e5-92e2-947c6b3d0b55 req-e1141db1-afcd-4530-ade1-5d4cffdcba6f tempest-AttachVolumeTestJSON-1685907325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62" returned: 0 in 0.864s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-459bb787-30e5-41e5-92e2-947c6b3d0b55 req-e1141db1-afcd-4530-ade1-5d4cffdcba6f tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.884s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-459bb787-30e5-41e5-92e2-947c6b3d0b55 req-e1141db1-afcd-4530-ade1-5d4cffdcba6f tempest-AttachVolumeTestJSON-1685907325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-c33e7079-862c-40a2-93ab-e1f328637f62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e0c04e6-3c4a-4c3b-9cf0-2a96c180a8d6', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:28:03 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-459bb787-30e5-41e5-92e2-947c6b3d0b55 req-e1141db1-afcd-4530-ade1-5d4cffdcba6f tempest-AttachVolumeTestJSON-1685907325 None] attachment_update completed successfully. Jul 07 22:28:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7ac6f2ca-076a-4594-b573-d9e64c36fe6b tempest-GroupsTest-656113774 None] Group tempest-Group1-1137849050: creating Jul 07 22:28:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7ac6f2ca-076a-4594-b573-d9e64c36fe6b tempest-GroupsTest-656113774 None] Group tempest-Group1-1137849050: created successfully Jul 07 22:28:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7ac6f2ca-076a-4594-b573-d9e64c36fe6b tempest-GroupsTest-656113774 None] Create group completed successfully. Jul 07 22:28:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cef407c4-906e-4452-ae0b-6d385f278ceb tempest-GroupsTest-656113774 None] Group tempest-Group2-378123117: creating Jul 07 22:28:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cef407c4-906e-4452-ae0b-6d385f278ceb tempest-GroupsTest-656113774 None] Group tempest-Group2-378123117: created successfully Jul 07 22:28:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cef407c4-906e-4452-ae0b-6d385f278ceb tempest-GroupsTest-656113774 None] Create group completed successfully. Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Flow 'volume_create_manager' (7715e23a-5a28-4152-b5e1-431de42e75ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80010831-1f13-48de-a12f-07bf1b8b3d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80010831-1f13-48de-a12f-07bf1b8b3d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1623747547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe8d1dc9-284c-40ea-969d-d552a8a3c7f1,host='devstack@QuobyteHD#QuobyteHD',id=371099ae-31c3-4481-8ea1-a3c9c5b4188a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc1f41dcd4e49ebb0c36bf10bd406fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:15Z,use_quota=True,user_id='901017ffd78541b491426bea3d606664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf015092-d044-42e0-a294-611a6ba90d2d),volume_type_id=bf015092-d044-42e0-a294-611a6ba90d2d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13454491-ee61-4d9e-8ac0-bfc3e3d82c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13454491-ee61-4d9e-8ac0-bfc3e3d82c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413af14f-65b7-468d-aa81-4ea1ca3e2a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413af14f-65b7-468d-aa81-4ea1ca3e2a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371099ae-31c3-4481-8ea1-a3c9c5b4188a', 'volume_name': 'volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddb2383-96e4-4427-85a8-c967afe6b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddb2383-96e4-4427-85a8-c967afe6b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f8461a-5b4d-43eb-86d8-a31b3cba1e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Volume 371099ae-31c3-4481-8ea1-a3c9c5b4188a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a', 'volume_size': 1} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe8d1dc9-284c-40ea-969d-d552a8a3c7f1,created_at=2026-07-07T20:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1623747547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe8d1dc9-284c-40ea-969d-d552a8a3c7f1,host='devstack@QuobyteHD#QuobyteHD',id=371099ae-31c3-4481-8ea1-a3c9c5b4188a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc1f41dcd4e49ebb0c36bf10bd406fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:15Z,use_quota=True,user_id='901017ffd78541b491426bea3d606664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf015092-d044-42e0-a294-611a6ba90d2d),volume_type_id=bf015092-d044-42e0-a294-611a6ba90d2d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Creating volume 371099ae-31c3-4481-8ea1-a3c9c5b4188a {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:28:15 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:28:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:15 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a 1073741824 Jul 07 22:28:15 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:16 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a 1073741824" returned: 0 in 1.084s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:16 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a Jul 07 22:28:16 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:17 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a" returned: 0 in 0.892s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:28:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f8461a-5b4d-43eb-86d8-a31b3cba1e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e335fd7-b564-48d3-896d-d6f50af09276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:17 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Volume volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a (371099ae-31c3-4481-8ea1-a3c9c5b4188a): created successfully Jul 07 22:28:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e335fd7-b564-48d3-896d-d6f50af09276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Flow 'volume_create_manager' (7715e23a-5a28-4152-b5e1-431de42e75ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8495ceed-bf64-4c0a-8a02-9824f3198b77 tempest-GroupsTest-656113774 None] Created volume successfully. Jul 07 22:28:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Acquiring lock "cinder-quobyte-371099ae-31c3-4481-8ea1-a3c9c5b4188a" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:28:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Lock "cinder-quobyte-371099ae-31c3-4481-8ea1-a3c9c5b4188a" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:28:18 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae63b86-1c07-4779-95d4-034671f86899]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:28:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:19 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a Jul 07 22:28:19 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:20 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a" returned: 0 in 1.150s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:20 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a Jul 07 22:28:20 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:21 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-371099ae-31c3-4481-8ea1-a3c9c5b4188a" returned: 0 in 1.417s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Lock "cinder-quobyte-371099ae-31c3-4481-8ea1-a3c9c5b4188a" released by "delete_volume" :: held 2.653s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:28:21 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Created reservations ['b5a562d9-1f7b-4b19-86e8-3263e5181780'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:28:21 devstack cinder-volume[87612]: WARNING cinder.quota [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-980295977 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-980295977, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:28:21 devstack cinder-volume[87612]: WARNING cinder.quota [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-980295977 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-980295977, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:28:21 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Created reservations ['53c1d8f3-eae6-4cad-86b7-a1aa8cf236a9', '3fb0022b-e5d8-4fc0-8a03-16cfa299631f', 'e3912c0a-970f-473a-abc8-fc4631e10648', '6c705211-f009-452e-bdae-acaed764ea9b'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:28:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:22 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:28:22 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Created reservations ['aabd66b4-c54b-4a34-8cb4-fbff730b9ce0'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:24 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:28:24 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:24 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 2.107s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:24 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:28:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-25824024-1b42-42f8-9b0c-ab98fb6ac0d7 tempest-GroupsTest-656113774 None] Delete group completed successfully. Jul 07 22:28:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b568d1e0-f31b-4a27-b964-966c56acb7e8 req-72105db8-cc04-4536-8428-6d4a56c7f530 tempest-AttachVolumeShelveTestJSON-179054744 None] No connector for attachment 698fe715-b535-4e1c-9fa5-403769205997; skipping storage backend terminate_connection call. {{(pid=87612) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 22:28:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b568d1e0-f31b-4a27-b964-966c56acb7e8 req-72105db8-cc04-4536-8428-6d4a56c7f530 tempest-AttachVolumeShelveTestJSON-179054744 None] Deleting attachment 698fe715-b535-4e1c-9fa5-403769205997. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:28:25 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.299s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:25 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:28:25 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-424fea86-ed12-4830-b337-8505b847238b tempest-GroupsTest-656113774 None] Delete group completed successfully. Jul 07 22:28:25 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-436e2a7d-159d-44b5-8adc-49f6cf9054d3 tempest-GroupsTest-656113774 None] Group tempest-GroupsTest-Group-581052956: creating Jul 07 22:28:25 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-436e2a7d-159d-44b5-8adc-49f6cf9054d3 tempest-GroupsTest-656113774 None] Group tempest-GroupsTest-Group-581052956: created successfully Jul 07 22:28:25 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-436e2a7d-159d-44b5-8adc-49f6cf9054d3 tempest-GroupsTest-656113774 None] Create group completed successfully. Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Flow 'volume_create_manager' (e8d72cd5-fa16-4890-a651-83e101dbdad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3c3901-3848-422e-9d2d-e9194cc0977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3c3901-3848-422e-9d2d-e9194cc0977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1344660120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f90ac87c-93a5-481b-92b6-45e4221a017e,host='devstack@QuobyteHD#QuobyteHD',id=e6334d20-66f1-4367-bdb4-09fbbfb48de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc1f41dcd4e49ebb0c36bf10bd406fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:28Z,use_quota=True,user_id='901017ffd78541b491426bea3d606664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5df838b3-3adc-4264-a8f3-a1997c1aa36e),volume_type_id=5df838b3-3adc-4264-a8f3-a1997c1aa36e)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc409b4-b1f5-4b78-ab81-0e222c7f93ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc409b4-b1f5-4b78-ab81-0e222c7f93ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37408f3-eae4-470e-bc93-1532062a192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37408f3-eae4-470e-bc93-1532062a192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6334d20-66f1-4367-bdb4-09fbbfb48de8', 'volume_name': 'volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed31557-422c-430a-8f5e-6aa265d1913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed31557-422c-430a-8f5e-6aa265d1913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65bcca7-6c48-4f9a-885a-f611da4da3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Volume e6334d20-66f1-4367-bdb4-09fbbfb48de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8', 'volume_size': 1} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f90ac87c-93a5-481b-92b6-45e4221a017e,created_at=2026-07-07T20:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1344660120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f90ac87c-93a5-481b-92b6-45e4221a017e,host='devstack@QuobyteHD#QuobyteHD',id=e6334d20-66f1-4367-bdb4-09fbbfb48de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc1f41dcd4e49ebb0c36bf10bd406fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:28Z,use_quota=True,user_id='901017ffd78541b491426bea3d606664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5df838b3-3adc-4264-a8f3-a1997c1aa36e),volume_type_id=5df838b3-3adc-4264-a8f3-a1997c1aa36e)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Creating volume e6334d20-66f1-4367-bdb4-09fbbfb48de8 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:28:28 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:28:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:28 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 1073741824 Jul 07 22:28:28 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:29 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 1073741824" returned: 0 in 1.078s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:29 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 Jul 07 22:28:29 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:30 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8" returned: 0 in 0.865s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:28:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65bcca7-6c48-4f9a-885a-f611da4da3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcd7122-6769-4491-a369-8ed1554608e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Volume volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 (e6334d20-66f1-4367-bdb4-09fbbfb48de8): created successfully Jul 07 22:28:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcd7122-6769-4491-a369-8ed1554608e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Flow 'volume_create_manager' (e8d72cd5-fa16-4890-a651-83e101dbdad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b1194528-fb7c-454d-bf33-47713f315d89 tempest-GroupsTest-656113774 None] Created volume successfully. Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Flow 'volume_create_manager' (70701166-3f0b-466a-be32-4c05c976ea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a728d1c2-26a1-4ebb-91b1-2e188991d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a728d1c2-26a1-4ebb-91b1-2e188991d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1587718002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f90ac87c-93a5-481b-92b6-45e4221a017e,host='devstack@QuobyteHD#QuobyteHD',id=9aa7e937-f4a0-4cbb-902f-bff687f554a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc1f41dcd4e49ebb0c36bf10bd406fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:32Z,use_quota=True,user_id='901017ffd78541b491426bea3d606664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5df838b3-3adc-4264-a8f3-a1997c1aa36e),volume_type_id=5df838b3-3adc-4264-a8f3-a1997c1aa36e)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f670876-5ac8-4bc7-9097-b6cbc4b2b60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f670876-5ac8-4bc7-9097-b6cbc4b2b60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2027b0-7d90-470e-bf63-0a2a36dcf0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2027b0-7d90-470e-bf63-0a2a36dcf0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa7e937-f4a0-4cbb-902f-bff687f554a3', 'volume_name': 'volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d80e6b-4bb2-45db-b547-ab460f1b7517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d80e6b-4bb2-45db-b547-ab460f1b7517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bc326e-ffd1-401e-89ed-208a8675e34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:31 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Volume 9aa7e937-f4a0-4cbb-902f-bff687f554a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3', 'volume_size': 1} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f90ac87c-93a5-481b-92b6-45e4221a017e,created_at=2026-07-07T20:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1587718002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f90ac87c-93a5-481b-92b6-45e4221a017e,host='devstack@QuobyteHD#QuobyteHD',id=9aa7e937-f4a0-4cbb-902f-bff687f554a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc1f41dcd4e49ebb0c36bf10bd406fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:32Z,use_quota=True,user_id='901017ffd78541b491426bea3d606664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5df838b3-3adc-4264-a8f3-a1997c1aa36e),volume_type_id=5df838b3-3adc-4264-a8f3-a1997c1aa36e)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Creating volume 9aa7e937-f4a0-4cbb-902f-bff687f554a3 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:28:31 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:28:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:31 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 1073741824 Jul 07 22:28:31 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:32 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 1073741824" returned: 0 in 0.964s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:32 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=46,cinder:INSERT=6,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:28:32 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=48,cinder:SELECT=47,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:28:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:32 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 Jul 07 22:28:32 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:33 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3" returned: 0 in 0.668s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:28:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bc326e-ffd1-401e-89ed-208a8675e34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe1b6b5-2b74-4077-8b10-837ce5af3dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:33 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Volume volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 (9aa7e937-f4a0-4cbb-902f-bff687f554a3): created successfully Jul 07 22:28:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe1b6b5-2b74-4077-8b10-837ce5af3dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Flow 'volume_create_manager' (70701166-3f0b-466a-be32-4c05c976ea89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-86d4ad14-dd1f-49b7-9309-c9be97fa36fc tempest-GroupsTest-656113774 None] Created volume successfully. Jul 07 22:28:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-522d2025-3587-4c66-bf36-a39fc3486af2 tempest-GroupsTest-656113774 None] Update group completed successfully. Jul 07 22:28:35 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c097d261-1c14-4f57-8426-c5dd707cd0c7 tempest-GroupsTest-656113774 None] Update group completed successfully. Jul 07 22:28:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Acquiring lock "cinder-quobyte-9aa7e937-f4a0-4cbb-902f-bff687f554a3" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:28:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Lock "cinder-quobyte-9aa7e937-f4a0-4cbb-902f-bff687f554a3" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:28:37 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b72f57-7c9d-45b6-97e1-1ce9e3753c3f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:28:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:37 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 Jul 07 22:28:37 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:39 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3" returned: 0 in 1.652s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:39 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3 Jul 07 22:28:39 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:40 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9aa7e937-f4a0-4cbb-902f-bff687f554a3" returned: 0 in 1.032s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Lock "cinder-quobyte-9aa7e937-f4a0-4cbb-902f-bff687f554a3" released by "delete_volume" :: held 2.752s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:28:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Acquiring lock "cinder-quobyte-e6334d20-66f1-4367-bdb4-09fbbfb48de8" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:28:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Lock "cinder-quobyte-e6334d20-66f1-4367-bdb4-09fbbfb48de8" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:28:40 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad1262-b7ae-428a-9bdb-f6ce573ddd12]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:28:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:40 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 Jul 07 22:28:40 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:41 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8" returned: 0 in 0.931s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:41 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8 Jul 07 22:28:41 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:42 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e6334d20-66f1-4367-bdb4-09fbbfb48de8" returned: 0 in 0.646s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Lock "cinder-quobyte-e6334d20-66f1-4367-bdb4-09fbbfb48de8" released by "delete_volume" :: held 1.621s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Created reservations ['db540938-905e-443f-aa1b-1ed61c2a7a51'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:28:42 devstack cinder-volume[87612]: WARNING cinder.quota [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-624670895 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-624670895, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:28:42 devstack cinder-volume[87612]: WARNING cinder.quota [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-624670895 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-624670895, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Created reservations ['32a8dc90-78c9-46d5-87bf-f54a1b27f242', 'de37f250-7d1b-4182-b542-5fdd8b97ad6e', '754d4a35-a4d1-4ce9-a619-db3f971a0862', 'ca0f9361-d05b-4e79-a78e-bcbc18d902b2'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Created reservations ['0dd6a3d6-f534-44b7-98cf-e27b8b606cae', '8c036c95-eae3-4168-82df-3793e6d69544', 'ed6200e9-50d4-49ee-b29f-0123c99258cb', '9faa5140-5629-4cf1-b3ea-f43cebbece28'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:42 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:28:42 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:43 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.815s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:43 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:28:43 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e10163bd-033a-4874-b7fe-4c61494d8583 tempest-GroupsTest-656113774 None] Delete group completed successfully. Jul 07 22:28:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-480be2a4-f803-4052-95d8-6e2bcc0047c4 req-87d847b4-4397-4a71-b2dc-c6a6b07b2d51 tempest-AttachVolumeNegativeTest-27436603 None] Terminate volume connection completed successfully. Jul 07 22:28:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-480be2a4-f803-4052-95d8-6e2bcc0047c4 req-87d847b4-4397-4a71-b2dc-c6a6b07b2d51 tempest-AttachVolumeNegativeTest-27436603 None] Deleting attachment 380ab94d-e912-4a95-ad5a-96250b16444e. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:28:51 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-8a2fabb6-6c4f-4262-94b4-8d347cae214e req-276d0b24-8084-4e54-8a35-3fef83aad191 tempest-AttachVolumeTestJSON-1685907325 None] Terminate volume connection completed successfully. Jul 07 22:28:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-8a2fabb6-6c4f-4262-94b4-8d347cae214e req-276d0b24-8084-4e54-8a35-3fef83aad191 tempest-AttachVolumeTestJSON-1685907325 None] Deleting attachment 9e0c04e6-3c4a-4c3b-9cf0-2a96c180a8d6. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:28:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:28:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:55 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:28:55 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:56 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.994s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:28:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:28:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 8 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:28:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Flow 'volume_create_manager' (8951f26f-ed2d-4990-a588-8d6b349c86eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64854b03-821c-4436-9b5b-ce61010b5832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64854b03-821c-4436-9b5b-ce61010b5832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1019446520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67360b21-0916-49cb-abd2-0696bf5ef6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80e94733e9a4da4a9cc81b4b54effbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:59Z,use_quota=True,user_id='eda493847a2a4a7c80f1b4517320af09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7f04af-a04e-423c-bedc-c7ad42fb0979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7f04af-a04e-423c-bedc-c7ad42fb0979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15a9aad-dd80-4676-bc78-0fb651d2c0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15a9aad-dd80-4676-bc78-0fb651d2c0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67360b21-0916-49cb-abd2-0696bf5ef6f6', 'volume_name': 'volume-67360b21-0916-49cb-abd2-0696bf5ef6f6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de5a130-732c-4b1c-97e6-54b9554edd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de5a130-732c-4b1c-97e6-54b9554edd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92ff36b-e4ff-4a8d-9840-9e1c9448102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:28:58 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Volume 67360b21-0916-49cb-abd2-0696bf5ef6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67360b21-0916-49cb-abd2-0696bf5ef6f6', 'volume_size': 1} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1019446520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67360b21-0916-49cb-abd2-0696bf5ef6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80e94733e9a4da4a9cc81b4b54effbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:28:59Z,use_quota=True,user_id='eda493847a2a4a7c80f1b4517320af09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Creating volume 67360b21-0916-49cb-abd2-0696bf5ef6f6 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:28:58 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:28:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:58 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 1073741824 Jul 07 22:28:58 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:28:59 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 07 22:28:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 1073741824" returned: 0 in 1.001s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:28:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:28:59 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 Jul 07 22:28:59 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:00 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6" returned: 0 in 0.742s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:29:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92ff36b-e4ff-4a8d-9840-9e1c9448102e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67360b21-0916-49cb-abd2-0696bf5ef6f6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a2b597-71c3-4510-8745-e530c863d2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:00 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Volume volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 (67360b21-0916-49cb-abd2-0696bf5ef6f6): created successfully Jul 07 22:29:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a2b597-71c3-4510-8745-e530c863d2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Flow 'volume_create_manager' (8951f26f-ed2d-4990-a588-8d6b349c86eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8866b151-9477-4262-982d-4227f7426903 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Created volume successfully. Jul 07 22:29:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Acquiring lock "cinder-67360b21-0916-49cb-abd2-0696bf5ef6f6-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "cinder-67360b21-0916-49cb-abd2-0696bf5ef6f6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Acquiring lock "cinder-quobyte-67360b21-0916-49cb-abd2-0696bf5ef6f6" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "cinder-quobyte-67360b21-0916-49cb-abd2-0696bf5ef6f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c00724-9d52-4526-949b-eee16947089b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:29:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:02 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 Jul 07 22:29:02 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:03 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6" returned: 0 in 0.810s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:03 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6 Jul 07 22:29:03 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:04 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-67360b21-0916-49cb-abd2-0696bf5ef6f6" returned: 0 in 0.754s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "cinder-quobyte-67360b21-0916-49cb-abd2-0696bf5ef6f6" released by "delete_volume" :: held 1.638s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Created reservations ['500a8994-b2c5-4236-b8fb-3b2d56c9d800', 'f0bf41eb-fd35-4ffb-aba9-40ac64ec3831', '4e04f183-8d70-427c-a121-4d6c504b857a', 'bea0f62e-cb4c-4dd7-8f04-0c405ebe1b91'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:04 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:29:04 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:05 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.986s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:05 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:29:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Deleted volume successfully. Jul 07 22:29:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66395908-efc7-4a62-a42e-d977424143e5 tempest-VolumeQuotasNegativeTestJSON-1797681924 None] Lock "cinder-67360b21-0916-49cb-abd2-0696bf5ef6f6-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Flow 'volume_create_manager' (9e43f03b-4913-4299-9e8f-b32a1dbb1d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f751bb4-a79b-4e51-98ee-791d96d76639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f751bb4-a79b-4e51-98ee-791d96d76639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1972445468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abeb8b80-12c5-4619-b870-61bd6813420f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05dd3c012ffb4a72958373fb834349e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:29:13Z,use_quota=True,user_id='0dcdc9a57a304cd7976256c0261519c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad5f7d6d-ff33-460c-8da9-c00d528bd4c1),volume_type_id=ad5f7d6d-ff33-460c-8da9-c00d528bd4c1)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc490d5-ff3b-4e72-9f18-fa37258ed435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc490d5-ff3b-4e72-9f18-fa37258ed435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a2e2e4-adde-4d3d-96f2-c053e19925cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a2e2e4-adde-4d3d-96f2-c053e19925cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abeb8b80-12c5-4619-b870-61bd6813420f', 'volume_name': 'volume-abeb8b80-12c5-4619-b870-61bd6813420f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a117f67-3c37-4498-8abb-197a00b63a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a117f67-3c37-4498-8abb-197a00b63a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5025135-79aa-423b-b379-5e245bd33d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:13 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Volume abeb8b80-12c5-4619-b870-61bd6813420f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abeb8b80-12c5-4619-b870-61bd6813420f', 'volume_size': 1} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1972445468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abeb8b80-12c5-4619-b870-61bd6813420f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05dd3c012ffb4a72958373fb834349e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:29:13Z,use_quota=True,user_id='0dcdc9a57a304cd7976256c0261519c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad5f7d6d-ff33-460c-8da9-c00d528bd4c1),volume_type_id=ad5f7d6d-ff33-460c-8da9-c00d528bd4c1)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Creating volume abeb8b80-12c5-4619-b870-61bd6813420f {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:29:13 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:29:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:13 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f 1073741824 Jul 07 22:29:13 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:14 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f 1073741824" returned: 0 in 1.160s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:14 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f Jul 07 22:29:14 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:15 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f" returned: 0 in 0.736s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:29:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5025135-79aa-423b-b379-5e245bd33d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abeb8b80-12c5-4619-b870-61bd6813420f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e010be-4977-4143-88bd-a4ed4769e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Volume volume-abeb8b80-12c5-4619-b870-61bd6813420f (abeb8b80-12c5-4619-b870-61bd6813420f): created successfully Jul 07 22:29:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e010be-4977-4143-88bd-a4ed4769e76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Flow 'volume_create_manager' (9e43f03b-4913-4299-9e8f-b32a1dbb1d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-0eb6ccb5-650a-4445-aefe-96aacde2e9d9 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Created volume successfully. Jul 07 22:29:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:17 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:29:17 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:18 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.242s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:18 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:29:18 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-de822596-719d-49b5-97fb-9182f9a9728c tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Retype volume completed successfully. Jul 07 22:29:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Acquiring lock "cinder-abeb8b80-12c5-4619-b870-61bd6813420f-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "cinder-abeb8b80-12c5-4619-b870-61bd6813420f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Acquiring lock "cinder-quobyte-abeb8b80-12c5-4619-b870-61bd6813420f" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "cinder-quobyte-abeb8b80-12c5-4619-b870-61bd6813420f" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:18 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c806302a-d5d4-4f41-a086-4cc6fb54a196]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:29:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:18 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f Jul 07 22:29:18 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:19 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f" returned: 0 in 1.111s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:19 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f Jul 07 22:29:19 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Acquiring lock "cinder-ed51eedf-27cb-4f52-9eff-8bd980c3257a-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "cinder-ed51eedf-27cb-4f52-9eff-8bd980c3257a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Acquiring lock "cinder-quobyte-ed51eedf-27cb-4f52-9eff-8bd980c3257a" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "cinder-quobyte-ed51eedf-27cb-4f52-9eff-8bd980c3257a" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306b853-4f55-4857-aa64-512b89346c4e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:20 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a Jul 07 22:29:20 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:20 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-abeb8b80-12c5-4619-b870-61bd6813420f" returned: 0 in 0.982s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "cinder-quobyte-abeb8b80-12c5-4619-b870-61bd6813420f" released by "delete_volume" :: held 2.192s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:29:20 devstack cinder-volume[87612]: WARNING cinder.quota [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:29:20 devstack cinder-volume[87612]: WARNING cinder.quota [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Created reservations ['f619860d-39d3-46ac-9cad-ebdfd4f78162', '09f289c7-a3dd-4f48-b963-245092175d91', 'd70ea651-ba31-49c8-a739-b405a7c0da43', '09578076-ced8-4bc6-80cf-02e9af9fcfaf'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:20 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:29:20 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:21 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a" returned: 0 in 1.142s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:21 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a Jul 07 22:29:21 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:21 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.031s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:21 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:29:21 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Deleted volume successfully. Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2f977ae1-9615-44f9-a0e2-1b717ebe6735 tempest-VolumeRetypeWithoutMigrationTest-1568240539 None] Lock "cinder-abeb8b80-12c5-4619-b870-61bd6813420f-delete_volume" released by "delete_volume" :: held 3.651s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:29:22 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ed51eedf-27cb-4f52-9eff-8bd980c3257a" returned: 0 in 1.051s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "cinder-quobyte-ed51eedf-27cb-4f52-9eff-8bd980c3257a" released by "delete_volume" :: held 2.291s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Created reservations ['9d39c68f-06f0-4adf-bad9-e11b629c1297', 'ed8aa4aa-650c-4651-ac70-f197f5a4dc52', 'a9e40702-5125-4ace-b1d6-e08f8ae6a988', '4693d002-35c8-418a-9dce-f2924ca20437'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:22 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:29:22 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:23 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.870s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:23 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:29:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Deleted volume successfully. Jul 07 22:29:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5ee7f13a-0b71-48ce-95b2-60bd23cb4a3a tempest-AttachVolumeShelveTestJSON-179054744 None] Lock "cinder-ed51eedf-27cb-4f52-9eff-8bd980c3257a-delete_volume" released by "delete_volume" :: held 3.528s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:29:32 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=61,cinder:SELECT=46,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:29:33 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=46,cinder:INSERT=13,cinder:UPDATE=54,cinder:DELETE=4 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:29:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-30288e41-267f-44af-bea9-ab59c5c62ab8 tempest-GroupSnapshotsTest-432939589 None] Group tempest-GroupSnapshotsTest-Group-2051862749: creating Jul 07 22:29:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-30288e41-267f-44af-bea9-ab59c5c62ab8 tempest-GroupSnapshotsTest-432939589 None] Group tempest-GroupSnapshotsTest-Group-2051862749: created successfully Jul 07 22:29:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-30288e41-267f-44af-bea9-ab59c5c62ab8 tempest-GroupSnapshotsTest-432939589 None] Create group completed successfully. Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Flow 'volume_create_manager' (efc42d98-500b-4b4c-aac8-df6ec4a71f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c02229-bcb2-43cd-954b-9d4f3fed1ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c02229-bcb2-43cd-954b-9d4f3fed1ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-631466512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00c092b0-3271-48e1-b4cf-8fe30feeb8ba,host='devstack@QuobyteHD#QuobyteHD',id=eb7d7d9d-4215-4677-b75f-d36712f9700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732a8de6a9504b6f81ebb35070cddef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:29:36Z,use_quota=True,user_id='d2e6901dc1b840c288685a19c65715dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb20b74f-3f9f-45af-803f-b055d8a880d4),volume_type_id=cb20b74f-3f9f-45af-803f-b055d8a880d4)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68ffe86-a799-4e96-bc9f-6fd570b03ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68ffe86-a799-4e96-bc9f-6fd570b03ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10611231-e084-4751-a32d-1c3110a17aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10611231-e084-4751-a32d-1c3110a17aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7d7d9d-4215-4677-b75f-d36712f9700f', 'volume_name': 'volume-eb7d7d9d-4215-4677-b75f-d36712f9700f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98564c3d-0262-413d-9fa6-cb7d0503e517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98564c3d-0262-413d-9fa6-cb7d0503e517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb06b84-dd2b-4ce5-ac04-e68836f481b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:36 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Volume eb7d7d9d-4215-4677-b75f-d36712f9700f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7d7d9d-4215-4677-b75f-d36712f9700f', 'volume_size': 1} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00c092b0-3271-48e1-b4cf-8fe30feeb8ba,created_at=2026-07-07T20:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-631466512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00c092b0-3271-48e1-b4cf-8fe30feeb8ba,host='devstack@QuobyteHD#QuobyteHD',id=eb7d7d9d-4215-4677-b75f-d36712f9700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732a8de6a9504b6f81ebb35070cddef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:29:36Z,use_quota=True,user_id='d2e6901dc1b840c288685a19c65715dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb20b74f-3f9f-45af-803f-b055d8a880d4),volume_type_id=cb20b74f-3f9f-45af-803f-b055d8a880d4)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Creating volume eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:29:36 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:29:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:36 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f 1073741824 Jul 07 22:29:36 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:37 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f 1073741824" returned: 0 in 0.943s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:37 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f Jul 07 22:29:37 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Flow 'volume_create_manager' (fc6f9ac8-f874-4fa9-a8ff-f7b5ef7188de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9211df-c06a-4564-8f50-9e10bf7a4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9211df-c06a-4564-8f50-9e10bf7a4a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1943428757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9131ce07-9dad-494a-b878-184ffe047a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac7438adfd14982822925325540e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:29:38Z,use_quota=True,user_id='d9cf87d57a204a09b49fd2ce99ffc05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dcba5a3-7859-4f48-add2-84d9410fbd87),volume_type_id=9dcba5a3-7859-4f48-add2-84d9410fbd87)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac2d3b0-7b1b-4857-a8e1-ff3cda822bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac2d3b0-7b1b-4857-a8e1-ff3cda822bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982a7881-a6b9-4f62-9553-127c52689b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982a7881-a6b9-4f62-9553-127c52689b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9131ce07-9dad-494a-b878-184ffe047a9a', 'volume_name': 'volume-9131ce07-9dad-494a-b878-184ffe047a9a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a662b5df-8746-417c-b0e6-cbab8cb76ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:38 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a662b5df-8746-417c-b0e6-cbab8cb76ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0880929a-9364-44a4-8211-fbf5486c9ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:38 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Volume 9131ce07-9dad-494a-b878-184ffe047a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9131ce07-9dad-494a-b878-184ffe047a9a', 'volume_size': 1} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f" returned: 0 in 0.914s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1943428757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9131ce07-9dad-494a-b878-184ffe047a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac7438adfd14982822925325540e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:29:38Z,use_quota=True,user_id='d9cf87d57a204a09b49fd2ce99ffc05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dcba5a3-7859-4f48-add2-84d9410fbd87),volume_type_id=9dcba5a3-7859-4f48-add2-84d9410fbd87)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Creating volume 9131ce07-9dad-494a-b878-184ffe047a9a {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:29:38 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:38 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a 1073741824 Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb06b84-dd2b-4ce5-ac04-e68836f481b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7d7d9d-4215-4677-b75f-d36712f9700f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:38 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd56d8f-2346-4783-8c96-7983b39c6c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:38 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Volume volume-eb7d7d9d-4215-4677-b75f-d36712f9700f (eb7d7d9d-4215-4677-b75f-d36712f9700f): created successfully Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd56d8f-2346-4783-8c96-7983b39c6c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Flow 'volume_create_manager' (efc42d98-500b-4b4c-aac8-df6ec4a71f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:38 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8eb4cfdb-0502-43f2-8e3e-7dde28786f21 tempest-GroupSnapshotsTest-432939589 None] Created volume successfully. Jul 07 22:29:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] GroupSnapshot 5b887556-d76d-43d8-a108-7e4dd60941f8: creating. Jul 07 22:29:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Group snapshot 5b887556-d76d-43d8-a108-7e4dd60941f8: creating. {{(pid=87612) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 22:29:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:39 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a 1073741824" returned: 0 in 1.124s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:39 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a Jul 07 22:29:39 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:40 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a" returned: 0 in 0.815s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.085s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0880929a-9364-44a4-8211-fbf5486c9ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9131ce07-9dad-494a-b878-184ffe047a9a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac266ae-78b0-4ac7-9f73-249f1b99eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Creating offline snapshot f9c8e524-7374-41b5-80d3-2187cb8d6705 of volume eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:29:40 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Volume volume-9131ce07-9dad-494a-b878-184ffe047a9a (9131ce07-9dad-494a-b878-184ffe047a9a): created successfully Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac266ae-78b0-4ac7-9f73-249f1b99eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Flow 'volume_create_manager' (fc6f9ac8-f874-4fa9-a8ff-f7b5ef7188de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1b3553-2571-45a1-91de-d925d51484bd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:29:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-0739650c-cdcb-409e-b2a9-f470aed8a025 tempest-VolumeTypesAccessTest-1239543274 None] Created volume successfully. Jul 07 22:29:40 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f Jul 07 22:29:40 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:41 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f" returned: 0 in 0.961s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:41 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 1G Jul 07 22:29:41 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Acquiring lock "cinder-9131ce07-9dad-494a-b878-184ffe047a9a-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Lock "cinder-9131ce07-9dad-494a-b878-184ffe047a9a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Acquiring lock "cinder-quobyte-9131ce07-9dad-494a-b878-184ffe047a9a" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Lock "cinder-quobyte-9131ce07-9dad-494a-b878-184ffe047a9a" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ccbb28-f7e0-4380-b30d-11bac8ef03ae]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:29:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:41 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a Jul 07 22:29:41 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:42 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 1G" returned: 0 in 1.210s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7d7d9d-4215-4677-b75f-d36712f9700f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:42 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7d7d9d-4215-4677-b75f-d36712f9700f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 Jul 07 22:29:42 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:42 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a" returned: 0 in 1.061s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:42 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a Jul 07 22:29:42 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:43 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7d7d9d-4215-4677-b75f-d36712f9700f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705" returned: 0 in 0.854s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:43 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:43 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 Jul 07 22:29:43 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:43 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9131ce07-9dad-494a-b878-184ffe047a9a" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Lock "cinder-quobyte-9131ce07-9dad-494a-b878-184ffe047a9a" released by "delete_volume" :: held 1.897s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:29:43 devstack cinder-volume[87612]: WARNING cinder.quota [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-227960630 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-227960630, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:29:43 devstack cinder-volume[87612]: WARNING cinder.quota [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-227960630 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-227960630, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Created reservations ['c9039731-183c-4529-8002-6bdaab6b4d10', 'b9edbe12-f527-431c-adca-9263b209d294', '97b0bc4e-3beb-4bc0-9be5-471adcf90241', 'e45f9bfe-47d0-45f4-a726-00aa7a7c515e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:43 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:29:43 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:29:44 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Flow 'volume_create_manager' (bdab0e53-20f6-46e1-8415-5a13f9706ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c780c465-9691-439a-9bb9-7525a8050b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705" returned: 0 in 1.034s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c780c465-9691-439a-9bb9-7525a8050b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-303030129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508294e6-5c26-4314-9238-936fb266bc1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb04e177052f4d0eaf067cf87fe6e715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:29:44Z,use_quota=True,user_id='d24bf6f5a95d4261834024e8c785121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb7db99-30f3-4c2f-b7ed-ccaff5760c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb7db99-30f3-4c2f-b7ed-ccaff5760c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac99e68-1b1a-44b7-906f-7bbb1d9d3f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac99e68-1b1a-44b7-906f-7bbb1d9d3f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '508294e6-5c26-4314-9238-936fb266bc1d', 'volume_name': 'volume-508294e6-5c26-4314-9238-936fb266bc1d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24823fb1-9025-4afd-ab25-a6badaf9e9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24823fb1-9025-4afd-ab25-a6badaf9e9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1a462d-4f3c-47bf-9811-3c5f7e451370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:44 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Volume 508294e6-5c26-4314-9238-936fb266bc1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-508294e6-5c26-4314-9238-936fb266bc1d', 'volume_size': 1} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:44 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.info Jul 07 22:29:44 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:44 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.960s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:29:44 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Deleted volume successfully. Jul 07 22:29:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d9068cf6-5780-447c-a7c0-bed3ed723b3a tempest-VolumeTypesAccessTest-1239543274 None] Lock "cinder-9131ce07-9dad-494a-b878-184ffe047a9a-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:29:45 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.info" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:45 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:29:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:45 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.info Jul 07 22:29:45 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:46 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.info" returned: 0 in 0.707s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.743s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.538s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-303030129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508294e6-5c26-4314-9238-936fb266bc1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb04e177052f4d0eaf067cf87fe6e715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:29:44Z,use_quota=True,user_id='d24bf6f5a95d4261834024e8c785121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Creating volume 508294e6-5c26-4314-9238-936fb266bc1d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:29:46 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:29:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:46 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d 1073741824 Jul 07 22:29:46 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:46 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3f344bb6-16c7-4f5a-a9ab-58d5a2a4df5b tempest-GroupSnapshotsTest-432939589 None] group_snapshot 5b887556-d76d-43d8-a108-7e4dd60941f8: created successfully Jul 07 22:29:47 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d 1073741824" returned: 0 in 1.035s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:47 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d Jul 07 22:29:47 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:48 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d" returned: 0 in 0.894s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1a462d-4f3c-47bf-9811-3c5f7e451370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508294e6-5c26-4314-9238-936fb266bc1d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f595cf5-0209-46ec-a276-0fbd8eb6cc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:29:48 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Volume volume-508294e6-5c26-4314-9238-936fb266bc1d (508294e6-5c26-4314-9238-936fb266bc1d): created successfully Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f595cf5-0209-46ec-a276-0fbd8eb6cc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Flow 'volume_create_manager' (bdab0e53-20f6-46e1-8415-5a13f9706ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:29:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a9ebc1f7-2f70-486c-a76e-668e84409c08 tempest-AttachVolumeNegativeTest-27436603 None] Created volume successfully. Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-f9c8e524-7374-41b5-80d3-2187cb8d6705-03526092-aeff-4bb4-8337-bee24b16b7c2" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-f9c8e524-7374-41b5-80d3-2187cb8d6705-03526092-aeff-4bb4-8337-bee24b16b7c2" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Creating volume 03526092-aeff-4bb4-8337-bee24b16b7c2 from snapshot f9c8e524-7374-41b5-80d3-2187cb8d6705 {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-03526092-aeff-4bb4-8337-bee24b16b7c2" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-03526092-aeff-4bb4-8337-bee24b16b7c2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] snapshot: f9c8e524-7374-41b5-80d3-2187cb8d6705, volume: 03526092-aeff-4bb4-8337-bee24b16b7c2, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f469bf78-8c8e-4492-b404-32fb24737a40]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:29:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:48 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 Jul 07 22:29:48 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:49 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705" returned: 0 in 1.266s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb7d7d9d-4215-4677-b75f-d36712f9700f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:29:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:29:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:29:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7da090-a8b5-485d-8f6d-59d4964617b3]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:29:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:49 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f Jul 07 22:29:49 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:50 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f" returned: 0 in 1.030s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:50 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:29:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:50 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 Jul 07 22:29:50 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-8ccb3c73-2355-45d6-b60d-fbb4754e37ec req-131e25c6-cc79-421d-9571-cb3dac34afe4 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:29:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:29:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:29:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:29:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:29:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:29:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:55 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:29:55 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:57 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.941s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:29:57 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:29:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 8 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:29:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:29:57 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2" returned: 0 in 7.119s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:57 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80bc42e-42fe-4840-ab4f-a0d9d1910308]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:29:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:58 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f Jul 07 22:29:58 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:29:59 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 07 22:29:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f" returned: 0 in 1.327s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:29:59 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f, size 1024.00 MB, duration 7.12 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:29:59 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Converted 1024.00 MB image at 143.82 MB/s Jul 07 22:29:59 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:29:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:29:59 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 Jul 07 22:29:59 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:00 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2" returned: 0 in 0.857s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-03526092-aeff-4bb4-8337-bee24b16b7c2" released by "_copy_volume_from_snapshot" :: held 11.763s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-f9c8e524-7374-41b5-80d3-2187cb8d6705-03526092-aeff-4bb4-8337-bee24b16b7c2" released by "_create_volume_from_snapshot" :: held 11.810s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.838s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-8ccb3c73-2355-45d6-b60d-fbb4754e37ec req-131e25c6-cc79-421d-9571-cb3dac34afe4 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.619s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a14cde-18eb-47ba-a086-a624c61fd23e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-8ccb3c73-2355-45d6-b60d-fbb4754e37ec req-131e25c6-cc79-421d-9571-cb3dac34afe4 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:00 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d Jul 07 22:30:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2a375021-3496-405b-bb18-9a91d90c3083 tempest-GroupSnapshotsTest-432939589 None] Create group from source-snapshot-5b887556-d76d-43d8-a108-7e4dd60941f8 completed successfully. Jul 07 22:30:00 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:01 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-8ccb3c73-2355-45d6-b60d-fbb4754e37ec req-131e25c6-cc79-421d-9571-cb3dac34afe4 tempest-AttachVolumeNegativeTest-27436603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d" returned: 0 in 1.147s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-8ccb3c73-2355-45d6-b60d-fbb4754e37ec req-131e25c6-cc79-421d-9571-cb3dac34afe4 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.180s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-8ccb3c73-2355-45d6-b60d-fbb4754e37ec req-131e25c6-cc79-421d-9571-cb3dac34afe4 tempest-AttachVolumeNegativeTest-27436603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-508294e6-5c26-4314-9238-936fb266bc1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21598525-1c71-4b19-ba56-8398970cf78c', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:30:01 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-8ccb3c73-2355-45d6-b60d-fbb4754e37ec req-131e25c6-cc79-421d-9571-cb3dac34afe4 tempest-AttachVolumeNegativeTest-27436603 None] attachment_update completed successfully. Jul 07 22:30:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-03526092-aeff-4bb4-8337-bee24b16b7c2" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-03526092-aeff-4bb4-8337-bee24b16b7c2" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:01 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3519aa08-ac8f-47fd-81a1-845afcc652e3]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:02 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 Jul 07 22:30:02 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:03 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2" returned: 0 in 1.247s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:03 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2 Jul 07 22:30:03 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:04 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03526092-aeff-4bb4-8337-bee24b16b7c2" returned: 0 in 0.902s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-03526092-aeff-4bb4-8337-bee24b16b7c2" released by "delete_volume" :: held 2.222s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Created reservations ['b04e7c0b-f0d7-491b-b9d4-24ec118f31a2'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:04 devstack cinder-volume[87612]: WARNING cinder.quota [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-251087652 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-251087652, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:30:04 devstack cinder-volume[87612]: WARNING cinder.quota [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-251087652 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-251087652, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Created reservations ['2e0aafce-03c9-4ff1-b09a-f4ce8ea123a8', 'a752f340-fedf-436d-8f87-5719350be56a', 'f6a0f9dd-131e-4ea0-98ce-37c4794dde42', 'ca6f4bc5-e649-4011-b22e-607dc0eb440e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:04 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:30:04 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Flow 'volume_create_manager' (3f9b48ca-f5b3-4799-9ee5-9365c0ceca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f49ed09-c75c-4d47-a376-ffd7eee8f44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f49ed09-c75c-4d47-a376-ffd7eee8f44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1643828864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffb1566-a4d0-464e-8d92-a5b7dce30225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29538acb32564fe89c504f8024cfc1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:04Z,use_quota=True,user_id='66bb6231ccb0463bad01c638f5822c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775f01e2-6360-4d7b-ae4f-103f1ca8ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775f01e2-6360-4d7b-ae4f-103f1ca8ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ea23ee-b2ae-4c59-8cbd-513d91fbe38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ea23ee-b2ae-4c59-8cbd-513d91fbe38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bffb1566-a4d0-464e-8d92-a5b7dce30225', 'volume_name': 'volume-bffb1566-a4d0-464e-8d92-a5b7dce30225', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabd1897-103a-472a-8ba9-04fb49eff484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabd1897-103a-472a-8ba9-04fb49eff484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7565e6f-cc11-41b0-84dc-f11cbf0c26d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Volume bffb1566-a4d0-464e-8d92-a5b7dce30225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bffb1566-a4d0-464e-8d92-a5b7dce30225', 'volume_size': 1} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1643828864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffb1566-a4d0-464e-8d92-a5b7dce30225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29538acb32564fe89c504f8024cfc1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:04Z,use_quota=True,user_id='66bb6231ccb0463bad01c638f5822c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Creating volume bffb1566-a4d0-464e-8d92-a5b7dce30225 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:04 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:04 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 1073741824 Jul 07 22:30:04 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:05 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.740s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ee24c195-2e79-4c52-a022-27524ddc7395 tempest-GroupSnapshotsTest-432939589 None] Delete group completed successfully. Jul 07 22:30:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] group_snapshot 5b887556-d76d-43d8-a108-7e4dd60941f8: deleting Jul 07 22:30:05 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 1073741824" returned: 0 in 1.020s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] group_snapshot 5b887556-d76d-43d8-a108-7e4dd60941f8: deleting {{(pid=87612) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-eb7d7d9d-4215-4677-b75f-d36712f9700f" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-eb7d7d9d-4215-4677-b75f-d36712f9700f" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-f9c8e524-7374-41b5-80d3-2187cb8d6705" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-f9c8e524-7374-41b5-80d3-2187cb8d6705" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Deleting offline snapshot f9c8e524-7374-41b5-80d3-2187cb8d6705 of volume eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:30:05 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 Jul 07 22:30:05 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] snapshot_file for this snap is: volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea9fd71-09ac-48a1-ac9b-caa37144a13d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:06 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 Jul 07 22:30:06 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:06 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225" returned: 0 in 0.782s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7565e6f-cc11-41b0-84dc-f11cbf0c26d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bffb1566-a4d0-464e-8d92-a5b7dce30225', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3f38ed-b5cf-4ca2-9e58-52482b71cab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:06 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Volume volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 (bffb1566-a4d0-464e-8d92-a5b7dce30225): created successfully Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3f38ed-b5cf-4ca2-9e58-52482b71cab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Flow 'volume_create_manager' (3f9b48ca-f5b3-4799-9ee5-9365c0ceca6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:06 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-05caa79a-6d60-4b45-87ba-22c8b0c88b52 tempest-VolumesListAdminTestJSON-1787516299 None] Created volume successfully. Jul 07 22:30:06 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705" returned: 0 in 1.011s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb7d7d9d-4215-4677-b75f-d36712f9700f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce91d54-3419-4468-b780-f42680ba7453]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:07 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f Jul 07 22:30:07 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:07 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f" returned: 0 in 0.907s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:07 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 Jul 07 22:30:07 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Flow 'volume_create_manager' (9b656803-0058-4cfa-b27c-55301744fc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b82b318-f49f-485f-a504-797fe006dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b82b318-f49f-485f-a504-797fe006dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1483069000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da67b5cc-030e-444e-9175-0aade62158d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29538acb32564fe89c504f8024cfc1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:08Z,use_quota=True,user_id='66bb6231ccb0463bad01c638f5822c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d323f0-dec1-4400-926f-9edf9ba21f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d323f0-dec1-4400-926f-9edf9ba21f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5a9007-9b3b-41cc-ac14-c8b4926faa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5a9007-9b3b-41cc-ac14-c8b4926faa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da67b5cc-030e-444e-9175-0aade62158d3', 'volume_name': 'volume-da67b5cc-030e-444e-9175-0aade62158d3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018b0e13-e7fa-43f3-bb55-7ece9a86cef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018b0e13-e7fa-43f3-bb55-7ece9a86cef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae75240f-30c8-4ed7-b408-657bc31ad2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:08 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Volume da67b5cc-030e-444e-9175-0aade62158d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da67b5cc-030e-444e-9175-0aade62158d3', 'volume_size': 1} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1483069000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da67b5cc-030e-444e-9175-0aade62158d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29538acb32564fe89c504f8024cfc1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:08Z,use_quota=True,user_id='66bb6231ccb0463bad01c638f5822c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Creating volume da67b5cc-030e-444e-9175-0aade62158d3 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:08 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:08 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 1073741824 Jul 07 22:30:08 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:08 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705" returned: 0 in 0.950s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:08 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705 Jul 07 22:30:08 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-a280ea62-7a9c-49dd-8c47-ccf9a6a39df2 req-3a525b10-8760-4530-9050-ad85c1c8a3ea tempest-AttachVolumeNegativeTest-27436603 None] Terminate volume connection completed successfully. Jul 07 22:30:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-a280ea62-7a9c-49dd-8c47-ccf9a6a39df2 req-3a525b10-8760-4530-9050-ad85c1c8a3ea tempest-AttachVolumeNegativeTest-27436603 None] Deleting attachment 21598525-1c71-4b19-ba56-8398970cf78c. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:30:09 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f.f9c8e524-7374-41b5-80d3-2187cb8d6705" returned: 0 in 0.720s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:09 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-f9c8e524-7374-41b5-80d3-2187cb8d6705" released by "_delete_snapshot" :: held 3.718s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 1073741824" returned: 0 in 1.072s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-eb7d7d9d-4215-4677-b75f-d36712f9700f" released by "delete_snapshot" :: held 3.749s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:09 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 Jul 07 22:30:09 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:09 devstack cinder-volume[87612]: WARNING cinder.quota [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-251087652 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-251087652, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:30:09 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] Created reservations ['68cdf67c-5723-4794-b8de-868c6f089497', '58946a91-0b0a-49a8-88a8-fac49e23e537', 'b00317b8-e3cd-46d8-837d-fadb387d2541', 'dfa2debb-5e1e-49d4-87b7-7026b255e288'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:09 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-aa14a2e4-bdd7-45a7-a961-25277189e0f8 tempest-GroupSnapshotsTest-432939589 None] group_snapshot 5b887556-d76d-43d8-a108-7e4dd60941f8: deleted successfully Jul 07 22:30:10 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3" returned: 0 in 0.719s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae75240f-30c8-4ed7-b408-657bc31ad2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da67b5cc-030e-444e-9175-0aade62158d3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370ca256-b336-48da-9a59-2a106817b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:10 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Volume volume-da67b5cc-030e-444e-9175-0aade62158d3 (da67b5cc-030e-444e-9175-0aade62158d3): created successfully Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370ca256-b336-48da-9a59-2a106817b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Flow 'volume_create_manager' (9b656803-0058-4cfa-b27c-55301744fc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:10 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6149d783-344c-43a1-ba96-09d043e0d206 tempest-VolumesListAdminTestJSON-1787516299 None] Created volume successfully. Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-eb7d7d9d-4215-4677-b75f-d36712f9700f" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-eb7d7d9d-4215-4677-b75f-d36712f9700f" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bdaa8c-8146-424f-9b55-7a086639221f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:10 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f Jul 07 22:30:10 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:11 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f" returned: 0 in 0.854s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:11 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f Jul 07 22:30:11 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:11 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Flow 'volume_create_manager' (012872bf-4f61-4678-9dac-75ce92ca07c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffcb845-0072-460e-8f4f-7a09328a2a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffcb845-0072-460e-8f4f-7a09328a2a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249363721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d68116-e6eb-41f7-ac92-149b506920a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29538acb32564fe89c504f8024cfc1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:12Z,use_quota=True,user_id='66bb6231ccb0463bad01c638f5822c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f399dd-9169-445a-92e6-ab78e3af8f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f399dd-9169-445a-92e6-ab78e3af8f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd30926e-a3f9-4fea-bbcc-6be22e4fe39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd30926e-a3f9-4fea-bbcc-6be22e4fe39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d68116-e6eb-41f7-ac92-149b506920a4', 'volume_name': 'volume-25d68116-e6eb-41f7-ac92-149b506920a4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a19e69f-4276-4a5e-a33d-91a48da49e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a19e69f-4276-4a5e-a33d-91a48da49e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7718152d-a0b4-4446-b0a8-07ae583e03ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:12 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Volume 25d68116-e6eb-41f7-ac92-149b506920a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d68116-e6eb-41f7-ac92-149b506920a4', 'volume_size': 1} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249363721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d68116-e6eb-41f7-ac92-149b506920a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29538acb32564fe89c504f8024cfc1e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:12Z,use_quota=True,user_id='66bb6231ccb0463bad01c638f5822c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Creating volume 25d68116-e6eb-41f7-ac92-149b506920a4 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:12 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:12 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 1073741824 Jul 07 22:30:12 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:12 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-eb7d7d9d-4215-4677-b75f-d36712f9700f" returned: 0 in 0.726s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-eb7d7d9d-4215-4677-b75f-d36712f9700f" released by "delete_volume" :: held 1.686s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Created reservations ['168687cb-f424-4b42-a84c-b6e61df11026'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:12 devstack cinder-volume[87612]: WARNING cinder.db.api [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-251087652'] Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Created reservations ['ead33db0-85b4-463a-848f-cb272887ff73', '32d5f1bf-e300-4657-9c0d-03378dd875be', '68041547-e51f-4504-b219-080d47c7fbc4', 'cd43d457-4462-4298-9a2d-80e645c3a0e3'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:12 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:30:12 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:13 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 1073741824" returned: 0 in 1.158s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:13 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 Jul 07 22:30:13 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-384a7a10-a6d7-4974-ac14-46ce2974b05f tempest-GroupSnapshotsTest-432939589 None] Group tempest-GroupSnapshotsTest-Group-439063021: creating Jul 07 22:30:13 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.165s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:13 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4060c1ce-dcff-49ca-93c3-5d00bee949fd tempest-GroupSnapshotsTest-432939589 None] Delete group completed successfully. Jul 07 22:30:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-384a7a10-a6d7-4974-ac14-46ce2974b05f tempest-GroupSnapshotsTest-432939589 None] Group tempest-GroupSnapshotsTest-Group-439063021: created successfully Jul 07 22:30:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-384a7a10-a6d7-4974-ac14-46ce2974b05f tempest-GroupSnapshotsTest-432939589 None] Create group completed successfully. Jul 07 22:30:14 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4" returned: 0 in 0.878s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7718152d-a0b4-4446-b0a8-07ae583e03ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d68116-e6eb-41f7-ac92-149b506920a4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bebefa9-a4e7-45de-8360-70a950e9e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:14 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Volume volume-25d68116-e6eb-41f7-ac92-149b506920a4 (25d68116-e6eb-41f7-ac92-149b506920a4): created successfully Jul 07 22:30:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bebefa9-a4e7-45de-8360-70a950e9e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Flow 'volume_create_manager' (012872bf-4f61-4678-9dac-75ce92ca07c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1b1dd5e1-560b-4447-8990-1de913906c77 tempest-VolumesListAdminTestJSON-1787516299 None] Created volume successfully. Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Flow 'volume_create_manager' (30f5c699-321b-4b5e-8ea4-2dfe8f5491c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24423909-bd94-4191-8d25-adbb5b0347d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24423909-bd94-4191-8d25-adbb5b0347d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2125897548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bce4d835-8a1c-44dc-ae45-9f9f3331b8a2,host='devstack@QuobyteHD#QuobyteHD',id=f29fdf3f-fdf0-44e8-bc57-ed05cde86d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732a8de6a9504b6f81ebb35070cddef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:15Z,use_quota=True,user_id='d2e6901dc1b840c288685a19c65715dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2709a651-0caa-4392-ad02-f81c0875a136),volume_type_id=2709a651-0caa-4392-ad02-f81c0875a136)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4063f1b-b39d-4080-81d4-1d9e158b21ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4063f1b-b39d-4080-81d4-1d9e158b21ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d29894-4090-40de-86db-13ff92ccafcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d29894-4090-40de-86db-13ff92ccafcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29fdf3f-fdf0-44e8-bc57-ed05cde86d14', 'volume_name': 'volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d9f1d4-ae3e-4515-a1d0-9430e316a1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d9f1d4-ae3e-4515-a1d0-9430e316a1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e0a6d0-6379-4786-bd3c-6657d8a0cc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Volume f29fdf3f-fdf0-44e8-bc57-ed05cde86d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14', 'volume_size': 1} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bce4d835-8a1c-44dc-ae45-9f9f3331b8a2,created_at=2026-07-07T20:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2125897548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bce4d835-8a1c-44dc-ae45-9f9f3331b8a2,host='devstack@QuobyteHD#QuobyteHD',id=f29fdf3f-fdf0-44e8-bc57-ed05cde86d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732a8de6a9504b6f81ebb35070cddef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:15Z,use_quota=True,user_id='d2e6901dc1b840c288685a19c65715dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2709a651-0caa-4392-ad02-f81c0875a136),volume_type_id=2709a651-0caa-4392-ad02-f81c0875a136)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Creating volume f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:15 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:15 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 1073741824 Jul 07 22:30:15 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Flow 'volume_create_manager' (3ce32c3f-8661-4779-9636-0461f5a79047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8c5a5e-eec1-4f2e-8235-73d1b3c6273a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8c5a5e-eec1-4f2e-8235-73d1b3c6273a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f026e1a-af27-4b26-8dca-5c9ba6426e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d1ec58dfd14091b48e0062f73e3eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:16Z,use_quota=True,user_id='d1792ad9da524caaae20932959d60b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afd4e08-b19c-43f7-a122-c6463e27ed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afd4e08-b19c-43f7-a122-c6463e27ed76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddb7f85-0c9b-4fae-9c97-97d390023aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddb7f85-0c9b-4fae-9c97-97d390023aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f026e1a-af27-4b26-8dca-5c9ba6426e72', 'volume_name': 'volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cc0e20-887e-4aa7-92a5-9fba414a636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cc0e20-887e-4aa7-92a5-9fba414a636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77343e63-20ee-4b66-8134-dd8f2319c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Volume 2f026e1a-af27-4b26-8dca-5c9ba6426e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72', 'volume_size': 1} Jul 07 22:30:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:16 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 1073741824" returned: 0 in 0.977s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:16 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 Jul 07 22:30:16 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:17 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" returned: 0 in 0.736s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.174s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f026e1a-af27-4b26-8dca-5c9ba6426e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d1ec58dfd14091b48e0062f73e3eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:16Z,use_quota=True,user_id='d1792ad9da524caaae20932959d60b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Creating volume 2f026e1a-af27-4b26-8dca-5c9ba6426e72 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:17 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:17 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 1073741824 Jul 07 22:30:17 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e0a6d0-6379-4786-bd3c-6657d8a0cc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b57f444-5012-4b4e-ac5d-f705c2ca243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:17 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Volume volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 (f29fdf3f-fdf0-44e8-bc57-ed05cde86d14): created successfully Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b57f444-5012-4b4e-ac5d-f705c2ca243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Flow 'volume_create_manager' (30f5c699-321b-4b5e-8ea4-2dfe8f5491c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2f70337f-1576-4346-a3ce-4989f11d8b55 tempest-GroupSnapshotsTest-432939589 None] Created volume successfully. Jul 07 22:30:18 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 1073741824" returned: 0 in 1.088s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:18 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 Jul 07 22:30:18 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Flow 'volume_create_manager' (a5f8051e-881d-408a-a663-63602fa466bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dc80d3-b7f7-4125-8bd9-e5ec8589adda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dc80d3-b7f7-4125-8bd9-e5ec8589adda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705129341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bce4d835-8a1c-44dc-ae45-9f9f3331b8a2,host='devstack@QuobyteHD#QuobyteHD',id=a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732a8de6a9504b6f81ebb35070cddef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:18Z,use_quota=True,user_id='d2e6901dc1b840c288685a19c65715dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2709a651-0caa-4392-ad02-f81c0875a136),volume_type_id=2709a651-0caa-4392-ad02-f81c0875a136)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b816003-b987-4405-9179-c085f0e932f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b816003-b987-4405-9179-c085f0e932f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4f1364-e598-4ace-bddd-4b6f89b560bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4f1364-e598-4ace-bddd-4b6f89b560bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b', 'volume_name': 'volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9d854c-cfef-4e49-bc65-4e3e622e2715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9d854c-cfef-4e49-bc65-4e3e622e2715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f168be2-4285-42d4-8482-4c61231cb76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:18 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Volume a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b', 'volume_size': 1} Jul 07 22:30:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:19 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72" returned: 0 in 0.921s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bce4d835-8a1c-44dc-ae45-9f9f3331b8a2,created_at=2026-07-07T20:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705129341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bce4d835-8a1c-44dc-ae45-9f9f3331b8a2,host='devstack@QuobyteHD#QuobyteHD',id=a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732a8de6a9504b6f81ebb35070cddef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:18Z,use_quota=True,user_id='d2e6901dc1b840c288685a19c65715dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2709a651-0caa-4392-ad02-f81c0875a136),volume_type_id=2709a651-0caa-4392-ad02-f81c0875a136)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Creating volume a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:19 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:19 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b 1073741824 Jul 07 22:30:19 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77343e63-20ee-4b66-8134-dd8f2319c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decdc9c4-901b-4bc5-b245-582179178624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:19 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Volume volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 (2f026e1a-af27-4b26-8dca-5c9ba6426e72): created successfully Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decdc9c4-901b-4bc5-b245-582179178624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Flow 'volume_create_manager' (3ce32c3f-8661-4779-9636-0461f5a79047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cf5d20be-95c1-4150-a5f5-479b891c9cf2 tempest-VolumesListAdminTestJSON-934463183 None] Created volume successfully. Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Acquiring lock "cinder-2f026e1a-af27-4b26-8dca-5c9ba6426e72-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Lock "cinder-2f026e1a-af27-4b26-8dca-5c9ba6426e72-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Acquiring lock "cinder-quobyte-2f026e1a-af27-4b26-8dca-5c9ba6426e72" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Lock "cinder-quobyte-2f026e1a-af27-4b26-8dca-5c9ba6426e72" acquired by "delete_volume" :: waited 0.040s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:20 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b 1073741824" returned: 0 in 1.197s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b910a310-4a9c-45e4-a34e-e4227d758b3a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "cinder-25d68116-e6eb-41f7-ac92-149b506920a4-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-25d68116-e6eb-41f7-ac92-149b506920a4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:20 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b Jul 07 22:30:20 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "cinder-quobyte-25d68116-e6eb-41f7-ac92-149b506920a4" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-quobyte-25d68116-e6eb-41f7-ac92-149b506920a4" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:20 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 Jul 07 22:30:20 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[710666de-b39a-49a0-a829-3038c71c8db7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:20 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 Jul 07 22:30:20 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:21 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" returned: 0 in 0.920s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f168be2-4285-42d4-8482-4c61231cb76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf59a360-e8cd-46b8-9fb7-6776a33f41af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:21 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Volume volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b (a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b): created successfully Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf59a360-e8cd-46b8-9fb7-6776a33f41af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Flow 'volume_create_manager' (a5f8051e-881d-408a-a663-63602fa466bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:21 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-83faef1b-1fc8-4fb8-821a-55029660a9ef tempest-GroupSnapshotsTest-432939589 None] Created volume successfully. Jul 07 22:30:21 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4" returned: 0 in 0.932s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:21 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4 Jul 07 22:30:21 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:21 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72" returned: 0 in 1.260s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:21 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72 Jul 07 22:30:21 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-41614180-1b86-4154-a55c-c0c8fce1d817 tempest-GroupSnapshotsTest-432939589 None] Update group completed successfully. Jul 07 22:30:22 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25d68116-e6eb-41f7-ac92-149b506920a4" returned: 0 in 0.867s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-quobyte-25d68116-e6eb-41f7-ac92-149b506920a4" released by "delete_volume" :: held 1.861s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Created reservations ['b6a0d7e6-0778-491e-96f4-a207c0918e85', '5c6a3f40-862b-4944-9023-8120e04517aa', '8859a5f8-f37c-43b5-8441-050ea7fcd76e', '3cc695f4-8867-4b3c-9fe5-928864fc8276'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:22 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2f026e1a-af27-4b26-8dca-5c9ba6426e72" returned: 0 in 0.906s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Lock "cinder-quobyte-2f026e1a-af27-4b26-8dca-5c9ba6426e72" released by "delete_volume" :: held 2.242s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:22 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:30:22 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Created reservations ['b1594569-de65-47f8-93df-d5c770f6ec2c', 'b8177b12-4be1-466a-b408-f285f4115640', '6c30c8d1-3743-4ddc-9e9d-b2ad40173b53', '739def55-89fb-4051-982c-229f548027a1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "cinder-da67b5cc-030e-444e-9175-0aade62158d3-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-da67b5cc-030e-444e-9175-0aade62158d3-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:22 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:30:22 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "cinder-quobyte-da67b5cc-030e-444e-9175-0aade62158d3" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-quobyte-da67b5cc-030e-444e-9175-0aade62158d3" acquired by "delete_volume" :: waited 0.043s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f6bec2-56c1-4c36-a59c-7fea4b18f6b8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:23 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 Jul 07 22:30:23 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Flow 'volume_create_manager' (d6bd9c68-17b1-40fa-8585-d7e25b56f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351d104e-c3c0-4f44-a8bb-f81c69254d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-986a3b18-01c9-4b58-9f48-efc6020a49f7 tempest-GroupSnapshotsTest-432939589 None] Update group completed successfully. Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351d104e-c3c0-4f44-a8bb-f81c69254d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1134204098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845d949b-eb17-4604-8133-8fe6a60c4bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9b3476083420fb355c27d6a3c44ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:24Z,use_quota=True,user_id='7a2d9dee20204c94b622ef9acdb8814a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53305c19-a987-4e56-ae43-2f787117bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:23 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53305c19-a987-4e56-ae43-2f787117bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b991b1-7500-472c-a3d8-1edb49c4112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b991b1-7500-472c-a3d8-1edb49c4112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845d949b-eb17-4604-8133-8fe6a60c4bae', 'volume_name': 'volume-845d949b-eb17-4604-8133-8fe6a60c4bae', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f423cfc-556d-47eb-a0ee-f7e28c2fb72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:23 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f423cfc-556d-47eb-a0ee-f7e28c2fb72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d4d3a2-74a6-4d5b-81ad-70b66350ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:23 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Volume 845d949b-eb17-4604-8133-8fe6a60c4bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845d949b-eb17-4604-8133-8fe6a60c4bae', 'volume_size': 1} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1134204098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845d949b-eb17-4604-8133-8fe6a60c4bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9b3476083420fb355c27d6a3c44ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:24Z,use_quota=True,user_id='7a2d9dee20204c94b622ef9acdb8814a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Creating volume 845d949b-eb17-4604-8133-8fe6a60c4bae {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:23 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.336s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.046s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:23 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Deleted volume successfully. Jul 07 22:30:24 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae 1073741824 Jul 07 22:30:24 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46c1365b-eff3-4ac0-9ca8-c7ccb18f1055 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-25d68116-e6eb-41f7-ac92-149b506920a4-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Deleted volume successfully. Jul 07 22:30:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a3abe6ba-59bc-40f1-a2de-25892d6e3ff7 tempest-VolumesListAdminTestJSON-934463183 None] Lock "cinder-2f026e1a-af27-4b26-8dca-5c9ba6426e72-delete_volume" released by "delete_volume" :: held 3.790s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:24 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3" returned: 0 in 1.239s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:24 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3 Jul 07 22:30:24 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9122c551-a6a4-4902-b419-7b1fd93b9821 tempest-GroupSnapshotsTest-432939589 None] Update group completed successfully. Jul 07 22:30:25 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae 1073741824" returned: 0 in 1.094s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:25 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae Jul 07 22:30:25 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:25 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da67b5cc-030e-444e-9175-0aade62158d3" returned: 0 in 0.847s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-quobyte-da67b5cc-030e-444e-9175-0aade62158d3" released by "delete_volume" :: held 2.186s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Created reservations ['2f9d6b3f-b1f2-4753-8a0c-0be186890c32', 'f75ef9ca-0567-4e8a-b8ba-e6eb4308e134', 'c79e4cbc-f09c-48bf-9e08-398a420b9b30', '7ce2427d-add1-465b-a3b6-98d859212e07'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:25 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:30:25 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:25 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae" returned: 0 in 0.664s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d4d3a2-74a6-4d5b-81ad-70b66350ca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845d949b-eb17-4604-8133-8fe6a60c4bae', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c53857-6ad5-4e80-8ec3-52546c867672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:25 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Volume volume-845d949b-eb17-4604-8133-8fe6a60c4bae (845d949b-eb17-4604-8133-8fe6a60c4bae): created successfully Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c53857-6ad5-4e80-8ec3-52546c867672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Flow 'volume_create_manager' (d6bd9c68-17b1-40fa-8585-d7e25b56f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:25 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-bb2a89af-4d38-4a53-a95a-71402f92dd00 tempest-AttachVolumeTestJSON-1685907325 None] Created volume successfully. Jul 07 22:30:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3d97ca26-11d7-488a-bf08-85d586afe4ab tempest-GroupSnapshotsTest-432939589 None] Update group completed successfully. Jul 07 22:30:26 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.723s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Deleted volume successfully. Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-688d5ea1-6576-4516-b77a-ef3d34363703 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-da67b5cc-030e-444e-9175-0aade62158d3-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "cinder-bffb1566-a4d0-464e-8d92-a5b7dce30225-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-bffb1566-a4d0-464e-8d92-a5b7dce30225-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "cinder-quobyte-bffb1566-a4d0-464e-8d92-a5b7dce30225" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-quobyte-bffb1566-a4d0-464e-8d92-a5b7dce30225" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[986ea4f6-72cf-4d99-aad8-37cab95d4a46]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:26 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 Jul 07 22:30:26 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:27 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225" returned: 0 in 0.827s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:27 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225 Jul 07 22:30:27 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:27 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] GroupSnapshot c9429518-1b33-4b6c-8424-a763c1275dfc: creating. Jul 07 22:30:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Group snapshot c9429518-1b33-4b6c-8424-a763c1275dfc: creating. {{(pid=87612) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 22:30:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Creating offline snapshot 56d200d1-084d-437d-8f09-92882c9f3434 of volume a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:30:27 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbbfc02-a8cf-4fd8-9e64-c7ca9b167fd9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:27 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b Jul 07 22:30:27 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:28 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bffb1566-a4d0-464e-8d92-a5b7dce30225" returned: 0 in 0.730s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-quobyte-bffb1566-a4d0-464e-8d92-a5b7dce30225" released by "delete_volume" :: held 1.616s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Created reservations ['9bc378d8-0fb0-4ca8-95db-27d18a992e02', '76ddecef-441e-4ae8-af9e-f048d36fb361', '591ef089-99de-4123-a3e2-d6b6d92aa404', '9fcc9d6d-a60b-4b20-99f0-0a6caceb5915'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:28 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:30:28 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:28 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" returned: 0 in 0.882s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:28 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 1G Jul 07 22:30:28 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:28 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.694s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:28 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Deleted volume successfully. Jul 07 22:30:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-76f4ae3e-31e2-436a-be5f-93614895f0f4 tempest-VolumesListAdminTestJSON-1787516299 None] Lock "cinder-bffb1566-a4d0-464e-8d92-a5b7dce30225-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:29 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 1G" returned: 0 in 1.222s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:29 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 Jul 07 22:30:29 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-594180db-cc5e-4a01-949a-d7893641f180 req-9e1d97d9-ffa3-4ea9-9a43-26160e20b5da tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:30 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434" returned: 0 in 1.173s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:30 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:30:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:30 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 Jul 07 22:30:30 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:32 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434" returned: 0 in 1.075s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:32 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.info Jul 07 22:30:32 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:32 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.info" returned: 0 in 0.850s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:32 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:30:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:32 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.info Jul 07 22:30:32 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:33 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.info" returned: 0 in 0.753s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.082s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:33 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=99,cinder:UPDATE=99,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:30:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Creating offline snapshot 6612d42a-4f5e-4b77-87df-07098892b7e8 of volume f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:30:33 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0246b489-639a-48bf-be88-ec07a50d7a14]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:33 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 Jul 07 22:30:33 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:34 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" returned: 0 in 0.808s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:34 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 1G Jul 07 22:30:34 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=103,cinder:UPDATE=119,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Flow 'volume_create_manager' (ba82e25e-f48f-4608-b013-4a0174923392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ec5be3-5bb6-456c-90de-375cf14a04bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ec5be3-5bb6-456c-90de-375cf14a04bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-378195201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a43fc2e-0fd0-4afc-89c3-210272c9eb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb646c07bba4cad8de0053850049953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:35Z,use_quota=True,user_id='8eac78e0801a440bbd470b5d527b6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29d3819-2d36-40e3-9f1a-399528ac5eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29d3819-2d36-40e3-9f1a-399528ac5eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c3ab9e-b01f-49c1-a925-4ab0be910e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c3ab9e-b01f-49c1-a925-4ab0be910e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a43fc2e-0fd0-4afc-89c3-210272c9eb00', 'volume_name': 'volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9719a5-fec2-4f8b-8037-ac36d33591a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9719a5-fec2-4f8b-8037-ac36d33591a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b04fe41-992a-443e-aad3-20f9261b92b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:35 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Volume 7a43fc2e-0fd0-4afc-89c3-210272c9eb00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00', 'volume_size': 1} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:35 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 1G" returned: 0 in 1.054s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:35 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 Jul 07 22:30:35 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:36 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8" returned: 0 in 0.880s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:36 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:30:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:36 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 Jul 07 22:30:36 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:37 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8" returned: 0 in 0.715s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:37 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.info Jul 07 22:30:37 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:37 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.info" returned: 0 in 0.743s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:37 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:30:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:38 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.info Jul 07 22:30:38 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:38 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.info" returned: 0 in 0.723s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.045s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-594180db-cc5e-4a01-949a-d7893641f180 req-9e1d97d9-ffa3-4ea9-9a43-26160e20b5da tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:38 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[203cf7a0-4a30-4059-b10e-71e2cf640449]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-594180db-cc5e-4a01-949a-d7893641f180 req-9e1d97d9-ffa3-4ea9-9a43-26160e20b5da tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:38 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae Jul 07 22:30:38 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c0e378b1-7863-4231-80cb-2b4a0e74cb67 tempest-GroupSnapshotsTest-432939589 None] group_snapshot c9429518-1b33-4b6c-8424-a763c1275dfc: created successfully Jul 07 22:30:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] group_snapshot c9429518-1b33-4b6c-8424-a763c1275dfc: deleting Jul 07 22:30:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] group_snapshot c9429518-1b33-4b6c-8424-a763c1275dfc: deleting {{(pid=87612) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 22:30:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-56d200d1-084d-437d-8f09-92882c9f3434" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:39 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-594180db-cc5e-4a01-949a-d7893641f180 req-9e1d97d9-ffa3-4ea9-9a43-26160e20b5da tempest-AttachVolumeTestJSON-1685907325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae" returned: 0 in 1.151s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-594180db-cc5e-4a01-949a-d7893641f180 req-9e1d97d9-ffa3-4ea9-9a43-26160e20b5da tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.187s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-56d200d1-084d-437d-8f09-92882c9f3434" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Deleting offline snapshot 56d200d1-084d-437d-8f09-92882c9f3434 of volume a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] snapshot_file for this snap is: volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.798s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-378195201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a43fc2e-0fd0-4afc-89c3-210272c9eb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb646c07bba4cad8de0053850049953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:35Z,use_quota=True,user_id='8eac78e0801a440bbd470b5d527b6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Creating volume 7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:40 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[97440cf9-1e47-4224-9451-001f3f535d4f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:40 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 1073741824 Jul 07 22:30:40 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-594180db-cc5e-4a01-949a-d7893641f180 req-9e1d97d9-ffa3-4ea9-9a43-26160e20b5da tempest-AttachVolumeTestJSON-1685907325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-845d949b-eb17-4604-8133-8fe6a60c4bae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfccb5f4-1c35-4132-8478-f407978b330a', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:30:40 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 Jul 07 22:30:40 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-594180db-cc5e-4a01-949a-d7893641f180 req-9e1d97d9-ffa3-4ea9-9a43-26160e20b5da tempest-AttachVolumeTestJSON-1685907325 None] attachment_update completed successfully. Jul 07 22:30:41 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434" returned: 0 in 1.367s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:30:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a04569-e058-4403-b93f-bfdf0d926e5f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:41 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 1073741824" returned: 0 in 1.586s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:41 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b Jul 07 22:30:41 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:41 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 Jul 07 22:30:41 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:42 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" returned: 0 in 1.034s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] <== create_volume: return (2688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:42 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" returned: 0 in 1.251s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b04fe41-992a-443e-aad3-20f9261b92b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fb415a-7f1e-43d2-b83c-8f254a234eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:42 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Volume volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 (7a43fc2e-0fd0-4afc-89c3-210272c9eb00): created successfully Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fb415a-7f1e-43d2-b83c-8f254a234eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:42 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 Jul 07 22:30:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Flow 'volume_create_manager' (ba82e25e-f48f-4608-b013-4a0174923392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:42 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:42 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-17bf956a-9662-411c-bf46-89e7bd76f023 tempest-VolumesDeleteCascade-613047038 None] Created volume successfully. Jul 07 22:30:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Creating offline snapshot 89f14de6-0e68-46a7-8e1e-260119bd6190 of volume 7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:30:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e66fd4-f616-4622-8647-f69b7b819570]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:43 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 Jul 07 22:30:43 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:43 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434" returned: 0 in 1.063s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:43 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434 Jul 07 22:30:43 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:44 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" returned: 0 in 0.965s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:44 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 1G Jul 07 22:30:44 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:44 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b.56d200d1-084d-437d-8f09-92882c9f3434" returned: 0 in 0.894s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-56d200d1-084d-437d-8f09-92882c9f3434" released by "_delete_snapshot" :: held 4.758s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" released by "delete_snapshot" :: held 4.811s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-6612d42a-4f5e-4b77-87df-07098892b7e8" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-6612d42a-4f5e-4b77-87df-07098892b7e8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Deleting offline snapshot 6612d42a-4f5e-4b77-87df-07098892b7e8 of volume f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] snapshot_file for this snap is: volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3887f54b-14d2-456c-929e-410ba4b00d89]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:44 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 Jul 07 22:30:44 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:45 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 1G" returned: 0 in 1.105s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:45 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 Jul 07 22:30:45 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:45 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8" returned: 0 in 1.033s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:30:45 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0619b-5161-43ae-83aa-a2ff50701dad]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:46 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 Jul 07 22:30:46 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Flow 'volume_create_manager' (c9dd4ef8-ab42-43db-bdf0-5436573cd482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94f1617-8b5c-494f-bfaa-661e45efc9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94f1617-8b5c-494f-bfaa-661e45efc9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1465160272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6747b1c-8bc1-4f04-b282-bf284bba71e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9b3476083420fb355c27d6a3c44ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:46Z,use_quota=True,user_id='7a2d9dee20204c94b622ef9acdb8814a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b42bbce-a900-41d0-ba5e-db34bdbd972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b42bbce-a900-41d0-ba5e-db34bdbd972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:46 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d64a24-2ac4-43ff-80d2-e4d3d75c8ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d64a24-2ac4-43ff-80d2-e4d3d75c8ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6747b1c-8bc1-4f04-b282-bf284bba71e6', 'volume_name': 'volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246d5e25-fc3e-4511-be76-2b289da2bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246d5e25-fc3e-4511-be76-2b289da2bc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aaaa7c-0b9b-4dc3-b9da-53b381b2cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:46 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Volume d6747b1c-8bc1-4f04-b282-bf284bba71e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6', 'volume_size': 1} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190" returned: 0 in 0.909s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:46 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 is being set with open permissions: ugo+rw Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:46 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 Jul 07 22:30:46 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:46 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" returned: 0 in 0.932s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:46 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 Jul 07 22:30:46 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:47 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190" returned: 0 in 0.738s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:47 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.info Jul 07 22:30:47 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:47 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8" returned: 0 in 0.825s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:47 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8 Jul 07 22:30:47 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:47 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.info" returned: 0 in 0.707s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:47 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.info is being set with open permissions: ugo+rw Jul 07 22:30:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:47 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.info Jul 07 22:30:47 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:48 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14.6612d42a-4f5e-4b77-87df-07098892b7e8" returned: 0 in 0.677s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-6612d42a-4f5e-4b77-87df-07098892b7e8" released by "_delete_snapshot" :: held 3.603s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" released by "delete_snapshot" :: held 3.636s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:48 devstack cinder-volume[87612]: WARNING cinder.quota [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-333640192 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-333640192, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:30:48 devstack cinder-volume[87612]: WARNING cinder.quota [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-333640192 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-333640192, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Created reservations ['d7661ca0-281a-4966-bab3-0b7a9d6ff41c', '2d2f46eb-d8d0-4eb3-9591-12d55f677324', 'cc3133f1-8e66-4286-b9ae-2e3af5a79522', '551ca76e-2e39-4a0e-8523-e8f783469de9'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] Created reservations ['d6817d85-6805-4567-af6c-e2404e7cfa7a', '4690a4fe-c51d-4831-b7a3-112d120b553e', '1e6d8b38-f01d-467c-99ac-1e29737161f2', 'c9e6a560-5cd9-4c50-ab83-342507fafaee'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:48 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.info" returned: 0 in 0.782s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.372s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.295s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1465160272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6747b1c-8bc1-4f04-b282-bf284bba71e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c9b3476083420fb355c27d6a3c44ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:46Z,use_quota=True,user_id='7a2d9dee20204c94b622ef9acdb8814a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Creating volume d6747b1c-8bc1-4f04-b282-bf284bba71e6 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:48 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:48 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 1073741824 Jul 07 22:30:48 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-98ad7d8b-e54c-461d-9009-6ccc6593d09c tempest-VolumesDeleteCascade-613047038 None] Create snapshot completed successfully Jul 07 22:30:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3c6b675e-c818-437a-ba79-0d104ad14896 tempest-GroupSnapshotsTest-432939589 None] group_snapshot c9429518-1b33-4b6c-8424-a763c1275dfc: deleted successfully Jul 07 22:30:49 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 1073741824" returned: 0 in 1.075s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:49 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 Jul 07 22:30:49 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4756f744-5b75-4b07-abaf-d5daa604ba6b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:50 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b Jul 07 22:30:50 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:50 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6" returned: 0 in 0.869s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.658s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Creating offline snapshot aab84ee6-9b54-4434-a992-7e01357480c2 of volume 7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aaaa7c-0b9b-4dc3-b9da-53b381b2cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40da8689-a1d7-4df5-8c7e-d25b6e4f3f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef23e465-c1eb-4550-be78-c2d774f5673d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:50 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Volume volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 (d6747b1c-8bc1-4f04-b282-bf284bba71e6): created successfully Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40da8689-a1d7-4df5-8c7e-d25b6e4f3f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Flow 'volume_create_manager' (c9dd4ef8-ab42-43db-bdf0-5436573cd482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-147fda0b-e784-4e91-8052-045d6240616f tempest-AttachVolumeTestJSON-1685907325 None] Created volume successfully. Jul 07 22:30:50 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 Jul 07 22:30:50 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:51 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" returned: 0 in 0.932s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:51 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b Jul 07 22:30:51 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:51 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190" returned: 0 in 1.032s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:30:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:51 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 1G Jul 07 22:30:51 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:52 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" returned: 0 in 0.734s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-a475cff6-2ddd-4e7a-8b0a-d9dfe7595f1b" released by "delete_volume" :: held 1.759s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" acquired by "delete_volume" :: waited 0.013s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:52 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc27f1b-2121-4703-99d5-6be6ba232bb6]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:52 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 Jul 07 22:30:52 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:52 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 1G" returned: 0 in 0.916s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:52 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 Jul 07 22:30:52 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:53 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" returned: 0 in 0.862s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:53 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14 Jul 07 22:30:53 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:53 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2" returned: 0 in 0.779s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:53 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 is being set with open permissions: ugo+rw Jul 07 22:30:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:53 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 Jul 07 22:30:53 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:53 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" returned: 0 in 0.743s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-f29fdf3f-fdf0-44e8-bc57-ed05cde86d14" released by "delete_volume" :: held 1.667s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:30:53 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Created reservations ['6024e42c-f5bc-46e6-89d8-00c9e66edc4b'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:54 devstack cinder-volume[87612]: WARNING cinder.quota [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-333640192 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-333640192, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Created reservations ['1a88f565-53f7-4301-98ae-3c9a051c8238', '11b25f2d-779d-4eef-9fcc-e1b4aa1c8e63', 'b964ae0d-0456-477c-b14e-9e709a1c4732', '8f9d2492-2a7a-43ce-a9a1-d7533b0765e8'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Created reservations ['d4411a31-bd9d-46f5-b51e-1d24868371a8', 'a1715d60-c9f3-4d98-9d49-fafd194d1623', '4f282704-248a-47ae-b46e-ea6be9f64c48', '0e2ff819-df73-412d-9990-fb9d5013c6b1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:30:54 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2" returned: 0 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.619s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:54 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-54936f66-313a-4256-b4e1-495db3bf4096 tempest-VolumesDeleteCascade-613047038 None] Create snapshot completed successfully Jul 07 22:30:54 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:30:54 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7ec0d41e-9298-4b2f-945e-45e3131f548e req-5e7d5e06-1ba3-4304-8af9-902879d8425a tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7ec0d41e-9298-4b2f-945e-45e3131f548e req-5e7d5e06-1ba3-4304-8af9-902879d8425a tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c29a073-cef6-4c97-abf1-9c573a9d458f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-7ec0d41e-9298-4b2f-945e-45e3131f548e req-5e7d5e06-1ba3-4304-8af9-902879d8425a tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:55 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 Jul 07 22:30:55 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:55 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.791s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:55 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-06ea107c-7308-4ac8-a154-3ae58068f35c tempest-GroupSnapshotsTest-432939589 None] Delete group completed successfully. Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-7a43fc2e-0fd0-4afc-89c3-210272c9eb00-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-7a43fc2e-0fd0-4afc-89c3-210272c9eb00-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Performing cascade delete. {{(pid=87612) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-89f14de6-0e68-46a7-8e1e-260119bd6190-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-89f14de6-0e68-46a7-8e1e-260119bd6190-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-89f14de6-0e68-46a7-8e1e-260119bd6190" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-89f14de6-0e68-46a7-8e1e-260119bd6190" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Deleting offline snapshot 89f14de6-0e68-46a7-8e1e-260119bd6190 of volume 7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] snapshot_file for this snap is: volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8873e3f0-78ec-4a50-9730-7f52a88b6c9e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:55 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 Jul 07 22:30:55 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:55 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:30:55 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:56 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-7ec0d41e-9298-4b2f-945e-45e3131f548e req-5e7d5e06-1ba3-4304-8af9-902879d8425a tempest-AttachVolumeTestJSON-1685907325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6" returned: 0 in 0.992s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7ec0d41e-9298-4b2f-945e-45e3131f548e req-5e7d5e06-1ba3-4304-8af9-902879d8425a tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-78dbd3bd-079e-4d26-8774-8b7c724cb58b tempest-GroupSnapshotsTest-432939589 None] Group tempest-GroupSnapshotsTest-Group-1869775662: creating Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7ec0d41e-9298-4b2f-945e-45e3131f548e req-5e7d5e06-1ba3-4304-8af9-902879d8425a tempest-AttachVolumeTestJSON-1685907325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc35ea70-d4b3-4c2f-aa6c-269e0990f45d', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:30:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-78dbd3bd-079e-4d26-8774-8b7c724cb58b tempest-GroupSnapshotsTest-432939589 None] Group tempest-GroupSnapshotsTest-Group-1869775662: created successfully Jul 07 22:30:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-78dbd3bd-079e-4d26-8774-8b7c724cb58b tempest-GroupSnapshotsTest-432939589 None] Create group completed successfully. Jul 07 22:30:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-7ec0d41e-9298-4b2f-945e-45e3131f548e req-5e7d5e06-1ba3-4304-8af9-902879d8425a tempest-AttachVolumeTestJSON-1685907325 None] attachment_update completed successfully. Jul 07 22:30:56 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.716s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 9 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:30:56 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190" returned: 0 in 1.092s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ddd4c-e583-469f-a391-e4a3656783f6]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:56 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 Jul 07 22:30:56 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:57 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" returned: 0 in 0.926s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1686df-62bc-425b-92d6-77fc627a1e9b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:57 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 Jul 07 22:30:57 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Flow 'volume_create_manager' (24001101-da35-48f0-a0b6-3a4ec78547af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbd7d47-c3d5-42e9-8cd2-ebe53efb15ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbd7d47-c3d5-42e9-8cd2-ebe53efb15ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-551473623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ac52ad7-84cf-4a82-a5c9-0aefdb7eafb8,host='devstack@QuobyteHD#QuobyteHD',id=bfa39ca0-da68-465a-9258-7f3269524772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732a8de6a9504b6f81ebb35070cddef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:58Z,use_quota=True,user_id='d2e6901dc1b840c288685a19c65715dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6aafb257-471e-40a8-be30-b7144a872e2a),volume_type_id=6aafb257-471e-40a8-be30-b7144a872e2a)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4404c7-6e99-4537-acce-a59f1c467ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4404c7-6e99-4537-acce-a59f1c467ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e791e4b-e1a7-40e9-b927-674c4cc0c2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e791e4b-e1a7-40e9-b927-674c4cc0c2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa39ca0-da68-465a-9258-7f3269524772', 'volume_name': 'volume-bfa39ca0-da68-465a-9258-7f3269524772', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a350dd17-9bd6-495b-8b14-2d30db565086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a350dd17-9bd6-495b-8b14-2d30db565086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb223e0b-b79d-4da7-8991-66212e9af3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:58 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Volume bfa39ca0-da68-465a-9258-7f3269524772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa39ca0-da68-465a-9258-7f3269524772', 'volume_size': 1} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6ac52ad7-84cf-4a82-a5c9-0aefdb7eafb8,created_at=2026-07-07T20:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-551473623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ac52ad7-84cf-4a82-a5c9-0aefdb7eafb8,host='devstack@QuobyteHD#QuobyteHD',id=bfa39ca0-da68-465a-9258-7f3269524772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732a8de6a9504b6f81ebb35070cddef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:30:58Z,use_quota=True,user_id='d2e6901dc1b840c288685a19c65715dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6aafb257-471e-40a8-be30-b7144a872e2a),volume_type_id=6aafb257-471e-40a8-be30-b7144a872e2a)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Creating volume bfa39ca0-da68-465a-9258-7f3269524772 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:30:58 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:58 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 1073741824 Jul 07 22:30:58 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:58 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2" returned: 0 in 0.986s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9167bb5-9ef2-445f-a76f-4684df53f7c8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:58 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 Jul 07 22:30:58 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:59 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 1073741824" returned: 0 in 1.074s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:59 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 Jul 07 22:30:59 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:59 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190" returned: 0 in 0.969s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f21154-71dc-4122-b7e4-043f8426e901]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:30:59 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 Jul 07 22:30:59 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:30:59 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772" returned: 0 in 0.785s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb223e0b-b79d-4da7-8991-66212e9af3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa39ca0-da68-465a-9258-7f3269524772', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:30:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb703a9-1fc9-4902-9960-0752ff202951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:30:59 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Volume volume-bfa39ca0-da68-465a-9258-7f3269524772 (bfa39ca0-da68-465a-9258-7f3269524772): created successfully Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb703a9-1fc9-4902-9960-0752ff202951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Flow 'volume_create_manager' (24001101-da35-48f0-a0b6-3a4ec78547af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7f5c5ed0-db09-4d6a-9cfc-c72d23d6ba07 tempest-GroupSnapshotsTest-432939589 None] Created volume successfully. Jul 07 22:31:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] GroupSnapshot 9fff4648-7216-4540-8165-e84369d57834: creating. Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Group snapshot 9fff4648-7216-4540-8165-e84369d57834: creating. {{(pid=87612) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Creating offline snapshot 10d67045-1eec-463f-918e-d70e33614af8 of volume bfa39ca0-da68-465a-9258-7f3269524772 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:31:00 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" returned: 0 in 0.986s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[828479c1-6a43-4c79-9dd3-829966234c6a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:00 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 Jul 07 22:31:00 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:00 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 Jul 07 22:31:00 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:01 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772" returned: 0 in 0.905s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:01 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190" returned: 0 in 0.954s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:01 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 1G Jul 07 22:31:01 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:01 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190 Jul 07 22:31:01 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:02 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.89f14de6-0e68-46a7-8e1e-260119bd6190" returned: 0 in 0.747s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 -F qcow2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:02 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 -F qcow2 Jul 07 22:31:02 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-159f7490-cfd6-4e06-adde-85d143734c33 req-5a9c5ca0-7ead-4fa7-847c-a6fc4ed56ec3 tempest-AttachVolumeTestJSON-1685907325 None] Terminate volume connection completed successfully. Jul 07 22:31:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-159f7490-cfd6-4e06-adde-85d143734c33 req-5a9c5ca0-7ead-4fa7-847c-a6fc4ed56ec3 tempest-AttachVolumeTestJSON-1685907325 None] Deleting attachment cfccb5f4-1c35-4132-8478-f407978b330a. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:31:02 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 1G" returned: 0 in 1.152s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa39ca0-da68-465a-9258-7f3269524772 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:02 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa39ca0-da68-465a-9258-7f3269524772 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 Jul 07 22:31:02 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:03 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 -F qcow2" returned: 0 in 0.832s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-89f14de6-0e68-46a7-8e1e-260119bd6190" released by "_delete_snapshot" :: held 7.736s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Flow 'volume_create_manager' (c8e6aa61-541c-4f78-a7c2-590278221a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8a71e4-a121-43b8-b1a1-a50d6e3d1bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" released by "delete_snapshot" :: held 7.799s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8a71e4-a121-43b8-b1a1-a50d6e3d1bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2018944588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb04e177052f4d0eaf067cf87fe6e715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:03Z,use_quota=True,user_id='d24bf6f5a95d4261834024e8c785121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114cbf22-9822-4c34-9084-192d753a1c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114cbf22-9822-4c34-9084-192d753a1c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c7f45e-1a48-4734-84aa-339cb74527ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c7f45e-1a48-4734-84aa-339cb74527ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16', 'volume_name': 'volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d17a8f4-a447-444b-94e7-396f00f9ca3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d17a8f4-a447-444b-94e7-396f00f9ca3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044384cc-3824-4946-84d1-3cae7d3b3fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:03 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Volume a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16', 'volume_size': 1} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:03 devstack cinder-volume[87612]: WARNING cinder.quota [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Created reservations ['eb82882e-5b5a-4813-982f-8af4acdecdfc', '2e7f8f70-f982-49dd-b20f-e13a45728090', 'd8906357-2462-406f-8c9c-e1180c6f7756', '1fff33ba-1fd6-4950-8d92-d4cf7eafb212'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:03 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Delete snapshot completed successfully. Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-89f14de6-0e68-46a7-8e1e-260119bd6190-delete_snapshot" released by "delete_snapshot" :: held 8.051s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-aab84ee6-9b54-4434-a992-7e01357480c2-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-aab84ee6-9b54-4434-a992-7e01357480c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-aab84ee6-9b54-4434-a992-7e01357480c2" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-aab84ee6-9b54-4434-a992-7e01357480c2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Deleting offline snapshot aab84ee6-9b54-4434-a992-7e01357480c2 of volume 7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] snapshot_file for this snap is: volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eebeaa-987d-4e17-bd70-f09f82f3c575]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:03 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa39ca0-da68-465a-9258-7f3269524772 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8" returned: 0 in 0.904s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:03 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:31:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:03 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 Jul 07 22:31:03 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:03 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 Jul 07 22:31:03 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:04 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8" returned: 0 in 0.793s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:04 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.info Jul 07 22:31:04 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:04 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2" returned: 0 in 0.898s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:31:04 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ae64b-3eeb-4257-b2e4-2c21fe685fc0]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:04 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 Jul 07 22:31:04 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:05 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.info" returned: 0 in 0.733s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:05 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:31:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:05 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.info Jul 07 22:31:05 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-ca5b1f2f-f092-4ad7-9268-98ec30e87e87 req-7840191f-a6d6-4388-bd4d-8345246f2878 tempest-AttachVolumeTestJSON-1685907325 None] Terminate volume connection completed successfully. Jul 07 22:31:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-ca5b1f2f-f092-4ad7-9268-98ec30e87e87 req-7840191f-a6d6-4388-bd4d-8345246f2878 tempest-AttachVolumeTestJSON-1685907325 None] Deleting attachment fc35ea70-d4b3-4c2f-aa6c-269e0990f45d. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:31:05 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" returned: 0 in 0.909s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:05 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 Jul 07 22:31:05 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:06 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.info" returned: 0 in 0.772s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.396s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.673s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2018944588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb04e177052f4d0eaf067cf87fe6e715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:03Z,use_quota=True,user_id='d24bf6f5a95d4261834024e8c785121e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Creating volume a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:31:06 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:06 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 1073741824 Jul 07 22:31:06 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:06 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9f24a44f-fa1e-4ae8-85f8-dcbbb5be51f2 tempest-GroupSnapshotsTest-432939589 None] group_snapshot 9fff4648-7216-4540-8165-e84369d57834: created successfully Jul 07 22:31:06 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2" returned: 0 in 0.961s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:06 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2 Jul 07 22:31:06 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:07 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 1073741824" returned: 0 in 1.047s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:07 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 Jul 07 22:31:07 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:07 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00.aab84ee6-9b54-4434-a992-7e01357480c2" returned: 0 in 0.858s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-aab84ee6-9b54-4434-a992-7e01357480c2" released by "_delete_snapshot" :: held 3.784s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" released by "delete_snapshot" :: held 3.822s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Created reservations ['038b827e-503d-4516-856b-0ae71e7cd169', '97632301-2b43-4ba2-a527-c2e7939b6085', 'd75d5dbd-d5ea-435f-9015-d157e2b852ba', '7ac3300b-d2d5-4dc8-9686-95b851576bb1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] group_snapshot 9fff4648-7216-4540-8165-e84369d57834: deleting Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] group_snapshot 9fff4648-7216-4540-8165-e84369d57834: deleting {{(pid=87612) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-bfa39ca0-da68-465a-9258-7f3269524772" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-bfa39ca0-da68-465a-9258-7f3269524772" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-10d67045-1eec-463f-918e-d70e33614af8" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Delete snapshot completed successfully. Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-aab84ee6-9b54-4434-a992-7e01357480c2-delete_snapshot" released by "delete_snapshot" :: held 4.146s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Snapshots deleted, issuing volume delete {{(pid=87612) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-10d67045-1eec-463f-918e-d70e33614af8" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Deleting offline snapshot 10d67045-1eec-463f-918e-d70e33614af8 of volume bfa39ca0-da68-465a-9258-7f3269524772 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] snapshot_file for this snap is: volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" acquired by "delete_volume" :: waited 0.077s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[06acb557-9fc7-45f3-9982-fafd6961407e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[463fef50-0a10-496b-b414-6d9bf4e7444d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:07 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 Jul 07 22:31:07 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:07 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 Jul 07 22:31:07 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:08 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16" returned: 0 in 0.866s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044384cc-3824-4946-84d1-3cae7d3b3fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ee14b3-7e25-48af-9377-ff5611284d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:08 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Volume volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 (a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16): created successfully Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ee14b3-7e25-48af-9377-ff5611284d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Flow 'volume_create_manager' (c8e6aa61-541c-4f78-a7c2-590278221a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cf75895a-bae1-4a6f-99e4-9892329884d1 tempest-AttachVolumeNegativeTest-27436603 None] Created volume successfully. Jul 07 22:31:08 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" returned: 0 in 0.972s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:08 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8" returned: 0 in 1.012s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfa39ca0-da68-465a-9258-7f3269524772(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:31:08 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00 Jul 07 22:31:08 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62db77-0ff8-4c69-abb5-fa86c1fec063]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:08 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 Jul 07 22:31:08 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:09 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" returned: 0 in 0.761s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-7a43fc2e-0fd0-4afc-89c3-210272c9eb00" released by "delete_volume" :: held 1.830s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Created reservations ['44e3128f-4bf6-4ee1-85ec-69bc0dc4cd89', '9f074563-3eb2-4092-95cf-7326882b3c9e', '01d3354d-ea04-4ad6-b14b-19c37c1d00ad', 'a9076b04-b652-4536-93e7-202e9ce66d1c'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:09 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:09 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772" returned: 0 in 1.033s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:09 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:09 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 Jul 07 22:31:09 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:10 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.145s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:10 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:10 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Deleted volume successfully. Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-74235379-50cd-4dda-8990-779d8cf85a81 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-7a43fc2e-0fd0-4afc-89c3-210272c9eb00-delete_volume" released by "delete_volume" :: held 15.634s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:11 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8" returned: 0 in 1.220s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:11 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8 Jul 07 22:31:11 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Flow 'volume_create_manager' (e55b5ddd-5c40-46c5-bd91-256e89a7b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ef469b-c6a8-4879-bb5a-5a60efc8f669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ef469b-c6a8-4879-bb5a-5a60efc8f669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1856043543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f35f08f-3d8a-4783-8f5e-307db7395bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb646c07bba4cad8de0053850049953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:12Z,use_quota=True,user_id='8eac78e0801a440bbd470b5d527b6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ef1bcc-7c0d-4669-8519-c53fb8089d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ef1bcc-7c0d-4669-8519-c53fb8089d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1cdebb-0692-4f85-bc96-168629687bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1cdebb-0692-4f85-bc96-168629687bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f35f08f-3d8a-4783-8f5e-307db7395bb8', 'volume_name': 'volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175c2309-49a0-49db-8e4e-e1cdf5efff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175c2309-49a0-49db-8e4e-e1cdf5efff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7775957d-f490-4f92-80a6-e38a5bc7f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:12 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Volume 9f35f08f-3d8a-4783-8f5e-307db7395bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8', 'volume_size': 1} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1856043543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f35f08f-3d8a-4783-8f5e-307db7395bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb646c07bba4cad8de0053850049953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:12Z,use_quota=True,user_id='8eac78e0801a440bbd470b5d527b6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Creating volume 9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:31:12 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:12 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:12 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 1073741824 Jul 07 22:31:12 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-72bf7ad6-89d5-4210-a720-be5617fb439a req-8866ca9c-de00-4bd2-b187-e93732cbb594 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772.10d67045-1eec-463f-918e-d70e33614af8" returned: 0 in 0.929s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-10d67045-1eec-463f-918e-d70e33614af8" released by "_delete_snapshot" :: held 4.400s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-bfa39ca0-da68-465a-9258-7f3269524772" released by "delete_snapshot" :: held 4.462s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:12 devstack cinder-volume[87612]: WARNING cinder.quota [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1059943647 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1059943647, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:31:12 devstack cinder-volume[87612]: WARNING cinder.quota [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1059943647 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1059943647, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:31:12 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] Created reservations ['49b25f7f-6c06-41fe-8d72-b6ec3995d026', '92092980-ac8f-4e56-bf7e-9d6cd91390e1', 'a6f12ed3-ef2b-4982-a710-8c8dbc3b8738', '5c605975-8b34-47df-8e87-29726020c54a'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-78605609-049b-4a03-a830-70a877145050 tempest-GroupSnapshotsTest-432939589 None] group_snapshot 9fff4648-7216-4540-8165-e84369d57834: deleted successfully Jul 07 22:31:13 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 1073741824" returned: 0 in 1.034s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:13 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 Jul 07 22:31:13 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "cinder-quobyte-bfa39ca0-da68-465a-9258-7f3269524772" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-bfa39ca0-da68-465a-9258-7f3269524772" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d312e594-0371-47e1-b9d4-71dc1d94b211]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:13 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 Jul 07 22:31:13 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:13 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8" returned: 0 in 0.815s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-72bf7ad6-89d5-4210-a720-be5617fb439a req-8866ca9c-de00-4bd2-b187-e93732cbb594 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.850s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7775957d-f490-4f92-80a6-e38a5bc7f18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e74d50a-c494-432f-b87d-d3fc3729335d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d92988-7a64-4340-a1da-3fc71beb8518]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-72bf7ad6-89d5-4210-a720-be5617fb439a req-8866ca9c-de00-4bd2-b187-e93732cbb594 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:13 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Volume volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 (9f35f08f-3d8a-4783-8f5e-307db7395bb8): created successfully Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e74d50a-c494-432f-b87d-d3fc3729335d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Flow 'volume_create_manager' (e55b5ddd-5c40-46c5-bd91-256e89a7b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d186068e-fca1-46c1-936d-77da696e7f9f tempest-VolumesDeleteCascade-613047038 None] Created volume successfully. Jul 07 22:31:14 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 Jul 07 22:31:14 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:14 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772" returned: 0 in 0.839s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:14 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772 Jul 07 22:31:14 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:14 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-72bf7ad6-89d5-4210-a720-be5617fb439a req-8866ca9c-de00-4bd2-b187-e93732cbb594 tempest-AttachVolumeNegativeTest-27436603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16" returned: 0 in 0.926s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-72bf7ad6-89d5-4210-a720-be5617fb439a req-8866ca9c-de00-4bd2-b187-e93732cbb594 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-72bf7ad6-89d5-4210-a720-be5617fb439a req-8866ca9c-de00-4bd2-b187-e93732cbb594 tempest-AttachVolumeNegativeTest-27436603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79b8d4fa-d25b-46a4-a397-2d78e01caf56', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:31:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-72bf7ad6-89d5-4210-a720-be5617fb439a req-8866ca9c-de00-4bd2-b187-e93732cbb594 tempest-AttachVolumeNegativeTest-27436603 None] attachment_update completed successfully. Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:15 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bfa39ca0-da68-465a-9258-7f3269524772" returned: 0 in 0.773s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Creating offline snapshot b28ab8b9-ba59-4798-b637-88a99c0f6b9f of volume 9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Lock "cinder-quobyte-bfa39ca0-da68-465a-9258-7f3269524772" released by "delete_volume" :: held 1.700s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a1901f-fdf2-4251-8397-f455711f2da8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Created reservations ['530110e2-b134-45d0-b9db-90a02b423454'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:15 devstack cinder-volume[87612]: WARNING cinder.quota [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1059943647 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1059943647, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Created reservations ['546a335d-22c1-45aa-8e60-cad46ac06195', '92b8078d-1b02-4d27-b88e-bb4e484457cd', 'c1bfafed-568e-4ebe-ad8a-8b006dcc4da2', 'abece784-ad94-421a-a950-1a0f368197b3'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:15 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 Jul 07 22:31:15 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:15 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:15 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:16 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8" returned: 0 in 1.113s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:16 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.922s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:16 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:16 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f 1G Jul 07 22:31:16 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:16 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d1cb4ad6-14f8-4330-ba1d-0b3f76c7b9bc tempest-GroupSnapshotsTest-432939589 None] Delete group completed successfully. Jul 07 22:31:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "cinder-d6747b1c-8bc1-4f04-b282-bf284bba71e6-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-d6747b1c-8bc1-4f04-b282-bf284bba71e6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "cinder-quobyte-d6747b1c-8bc1-4f04-b282-bf284bba71e6" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-quobyte-d6747b1c-8bc1-4f04-b282-bf284bba71e6" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192e886-1410-47f4-9d59-9121e182c5f7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:17 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 Jul 07 22:31:17 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:17 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f 1G" returned: 0 in 1.106s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:17 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f Jul 07 22:31:17 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:18 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6" returned: 0 in 0.895s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:18 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6 Jul 07 22:31:18 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:18 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f" returned: 0 in 0.890s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:18 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f is being set with open permissions: ugo+rw Jul 07 22:31:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:18 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f Jul 07 22:31:18 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:18 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d6747b1c-8bc1-4f04-b282-bf284bba71e6" returned: 0 in 0.779s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-quobyte-d6747b1c-8bc1-4f04-b282-bf284bba71e6" released by "delete_volume" :: held 1.742s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:18 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Created reservations ['f06962b7-67b6-43b6-9dc6-4e252a294f77', '59ff97cc-61a3-496a-a4c6-2178ba0bb0b0', '710741c6-33d1-4736-b5c1-2a07063e5eec', 'bd2c5839-52bf-466c-8f54-6c7bd5357d04'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:19 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:19 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:19 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f" returned: 0 in 0.789s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:19 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.info Jul 07 22:31:19 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "cinder-845d949b-eb17-4604-8133-8fe6a60c4bae-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-845d949b-eb17-4604-8133-8fe6a60c4bae-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "cinder-quobyte-845d949b-eb17-4604-8133-8fe6a60c4bae" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-quobyte-845d949b-eb17-4604-8133-8fe6a60c4bae" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef32aa-1ea2-4049-a2ea-2a34f937d832]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:19 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae Jul 07 22:31:19 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:19 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.853s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Deleted volume successfully. Jul 07 22:31:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-78550a97-1eb3-4e66-be69-b6b082526fa2 tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-d6747b1c-8bc1-4f04-b282-bf284bba71e6-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:20 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.info" returned: 0 in 0.849s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:20 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.info is being set with open permissions: ugo+rw Jul 07 22:31:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:20 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.info Jul 07 22:31:20 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:20 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae" returned: 0 in 1.104s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:20 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae Jul 07 22:31:20 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:20 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.info" returned: 0 in 0.852s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.727s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:20 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6df56b63-3459-4e0c-b639-72e465a25b82 tempest-VolumesDeleteCascade-613047038 None] Create snapshot completed successfully Jul 07 22:31:21 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-845d949b-eb17-4604-8133-8fe6a60c4bae" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-quobyte-845d949b-eb17-4604-8133-8fe6a60c4bae" released by "delete_volume" :: held 1.938s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Created reservations ['2ef79089-b1f0-455e-bf44-b963097171a6', '56d861c8-2b63-41bd-90df-093600558deb', 'dbe227fc-833b-4b52-9a7a-204f9165c889', '51346b64-779a-43e0-8f23-11eddf63ef69'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:21 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:21 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "cinder-c33e7079-862c-40a2-93ab-e1f328637f62-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-c33e7079-862c-40a2-93ab-e1f328637f62-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-c228cc86-54d9-4877-81b0-c169d07d4ceb req-521504b5-9958-4101-b62c-34c59af24754 tempest-AttachVolumeNegativeTest-27436603 None] Terminate volume connection completed successfully. Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-c228cc86-54d9-4877-81b0-c169d07d4ceb req-521504b5-9958-4101-b62c-34c59af24754 tempest-AttachVolumeNegativeTest-27436603 None] Deleting attachment 79b8d4fa-d25b-46a4-a397-2d78e01caf56. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "cinder-quobyte-c33e7079-862c-40a2-93ab-e1f328637f62" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-quobyte-c33e7079-862c-40a2-93ab-e1f328637f62" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[962146d3-56f0-4826-92db-83dfe81f094d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:31:22 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 Jul 07 22:31:22 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Flow 'volume_create_manager' (22c3f9f5-1379-4ab6-a647-26a56dc89688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c51e2a-7446-45a1-b42d-404e86d16e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c51e2a-7446-45a1-b42d-404e86d16e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-939586793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ba5405-c9d3-42d3-b27a-c5bb1cab9c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb646c07bba4cad8de0053850049953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b28ab8b9-ba59-4798-b637-88a99c0f6b9f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:22Z,use_quota=True,user_id='8eac78e0801a440bbd470b5d527b6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5709c196-ac48-4976-8da3-3da735f95ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5709c196-ac48-4976-8da3-3da735f95ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ceeb9a-217e-4501-9b37-a1d23e753410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ceeb9a-217e-4501-9b37-a1d23e753410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28ba5405-c9d3-42d3-b27a-c5bb1cab9c06', 'volume_name': 'volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06', 'volume_size': 1, 'snapshot_id': 'b28ab8b9-ba59-4798-b637-88a99c0f6b9f'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41336ae-237c-4586-bdbe-914cdcc9062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41336ae-237c-4586-bdbe-914cdcc9062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7669b5-504c-461d-ab68-c1a5242f9163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Volume 28ba5405-c9d3-42d3-b27a-c5bb1cab9c06: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06', 'volume_size': 1, 'snapshot_id': 'b28ab8b9-ba59-4798-b637-88a99c0f6b9f'} Jul 07 22:31:22 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-b28ab8b9-ba59-4798-b637-88a99c0f6b9f-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.072s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Deleted volume successfully. Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-b28ab8b9-ba59-4798-b637-88a99c0f6b9f-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Creating volume 28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 from snapshot b28ab8b9-ba59-4798-b637-88a99c0f6b9f {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] snapshot: b28ab8b9-ba59-4798-b637-88a99c0f6b9f, volume: 28ba5405-c9d3-42d3-b27a-c5bb1cab9c06, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8678c4b2-ede5-44e7-9956-852218e6f152 tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-845d949b-eb17-4604-8133-8fe6a60c4bae-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314f6a3-95f4-44e9-97ab-779cbd344d55]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:22 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f Jul 07 22:31:22 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ebcceaed-e31a-4f30-b815-7bbbc9a29b4e tempest-GroupsV320Test-1025655874 None] Group tempest-GroupsV320Test-Group-1506076269: creating Jul 07 22:31:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ebcceaed-e31a-4f30-b815-7bbbc9a29b4e tempest-GroupsV320Test-1025655874 None] Group tempest-GroupsV320Test-Group-1506076269: created successfully Jul 07 22:31:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ebcceaed-e31a-4f30-b815-7bbbc9a29b4e tempest-GroupsV320Test-1025655874 None] Create group completed successfully. Jul 07 22:31:23 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62" returned: 0 in 0.968s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:23 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62 Jul 07 22:31:23 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:23 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f" returned: 0 in 0.985s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:31:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:31:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:31:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4412934a-0593-4a3f-8bcf-9a54908a0217]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:23 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 Jul 07 22:31:23 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:24 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c33e7079-862c-40a2-93ab-e1f328637f62" returned: 0 in 0.780s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-quobyte-c33e7079-862c-40a2-93ab-e1f328637f62" released by "delete_volume" :: held 1.812s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Created reservations ['de1d6d12-954f-43f5-9afd-fde64053d399', '21c5de4c-4ead-46d0-85e5-c5357c180ed8', '87fc11da-38f9-4cf7-b6b8-cc4e4164ca61', 'c34b2e86-2994-4ba2-9b7e-018502a0fa04'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:24 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:24 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:24 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8" returned: 0 in 1.182s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:25 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 Jul 07 22:31:25 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Created reservations ['0665a464-e477-4941-917e-c77400f4bc39'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:25 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:25 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:25 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.881s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:25 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Deleted volume successfully. Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-38fe4798-f191-4769-b916-20d2a46e307b tempest-AttachVolumeTestJSON-1685907325 None] Lock "cinder-c33e7079-862c-40a2-93ab-e1f328637f62-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:25 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.783s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:26 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-838928d4-1415-4dbf-ab44-24c34124fdea tempest-GroupsV320Test-1025655874 None] Delete group completed successfully. Jul 07 22:31:31 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" returned: 0 in 6.672s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:31 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a109c748-d724-4f1f-945b-58184f2a633d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:31 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 Jul 07 22:31:31 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:32 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8" returned: 0 in 1.156s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:32 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:31:32 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Converted 1024.00 MB image at 153.45 MB/s Jul 07 22:31:32 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 is being set with open permissions: ugo+rw Jul 07 22:31:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:32 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 Jul 07 22:31:32 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:33 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" returned: 0 in 1.128s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" released by "_copy_volume_from_snapshot" :: held 11.285s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-b28ab8b9-ba59-4798-b637-88a99c0f6b9f-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" released by "_create_volume_from_snapshot" :: held 11.321s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.348s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7669b5-504c-461d-ab68-c1a5242f9163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06', 'volume_size': 1, 'snapshot_id': 'b28ab8b9-ba59-4798-b637-88a99c0f6b9f'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a80a96-2c34-4f4d-9802-e9eaf6cd7a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:34 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=126,cinder:UPDATE=129,cinder:DELETE=7,cinder:INSERT=30 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:31:34 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Volume volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 (28ba5405-c9d3-42d3-b27a-c5bb1cab9c06): created successfully Jul 07 22:31:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a80a96-2c34-4f4d-9802-e9eaf6cd7a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Flow 'volume_create_manager' (22c3f9f5-1379-4ab6-a647-26a56dc89688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d770c6fc-dc58-423e-87f0-a8c231b9266e tempest-VolumesDeleteCascade-613047038 None] Created volume successfully. Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-9f35f08f-3d8a-4783-8f5e-307db7395bb8-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-9f35f08f-3d8a-4783-8f5e-307db7395bb8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=124,cinder:INSERT=30,cinder:SELECT=134,cinder:DELETE=6 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Performing cascade delete. {{(pid=87612) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-b28ab8b9-ba59-4798-b637-88a99c0f6b9f-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-b28ab8b9-ba59-4798-b637-88a99c0f6b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-9f35f08f-3d8a-4783-8f5e-307db7395bb8" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-9f35f08f-3d8a-4783-8f5e-307db7395bb8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-b28ab8b9-ba59-4798-b637-88a99c0f6b9f" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-b28ab8b9-ba59-4798-b637-88a99c0f6b9f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Deleting offline snapshot b28ab8b9-ba59-4798-b637-88a99c0f6b9f of volume 9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] snapshot_file for this snap is: volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80ad2b6-f9d6-4a6d-805e-76584da58707]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:35 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f Jul 07 22:31:35 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "cinder-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "cinder-quobyte-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-quobyte-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef30d3db-73d1-4772-9dbf-458e6b9aabdf]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:36 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 Jul 07 22:31:36 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:36 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f" returned: 0 in 1.120s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e81603-28d9-4912-97e0-1b9518403d59]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:36 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 Jul 07 22:31:36 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:37 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16" returned: 0 in 1.013s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:37 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16 Jul 07 22:31:37 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:37 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8" returned: 0 in 1.009s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:37 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f Jul 07 22:31:37 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:38 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16" returned: 0 in 0.934s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-quobyte-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16" released by "delete_volume" :: held 2.035s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Flow 'volume_create_manager' (769d0409-4890-40eb-8990-df71d77241a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1685935-5fec-4ba2-b26e-1f3dae0252e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1685935-5fec-4ba2-b26e-1f3dae0252e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1006153281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f76bc3-6ae4-409d-b422-c1378276ddc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501f9139b0934297a55da7fec92f2697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:38Z,use_quota=True,user_id='6368a3c170e64abca487cc3aed79f010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32b93b5-dc5c-474d-801c-398fbef58a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32b93b5-dc5c-474d-801c-398fbef58a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff49ce8-98bb-4bfe-8489-9d1af159ab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff49ce8-98bb-4bfe-8489-9d1af159ab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f76bc3-6ae4-409d-b422-c1378276ddc1', 'volume_name': 'volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90134155-e3c2-47e0-a7b4-1719f834145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90134155-e3c2-47e0-a7b4-1719f834145f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3dd328-d118-47ba-a963-5e7a050c7ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:38 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Volume c1f76bc3-6ae4-409d-b422-c1378276ddc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1', 'volume_size': 1} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1006153281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f76bc3-6ae4-409d-b422-c1378276ddc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501f9139b0934297a55da7fec92f2697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:38Z,use_quota=True,user_id='6368a3c170e64abca487cc3aed79f010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Creating volume c1f76bc3-6ae4-409d-b422-c1378276ddc1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:31:38 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:38 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 1073741824 Jul 07 22:31:38 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Created reservations ['d5cd66f1-fd14-4585-bc4b-8a0868d8b90e', '8bcf9679-c1b7-4044-b8d4-0d48d322d059', 'edbff237-9437-4665-8154-0fda18054ba4', 'a404a267-d970-4fe8-a6ad-295172e16c71'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:38 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:38 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:38 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f" returned: 0 in 1.108s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:38 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f Jul 07 22:31:38 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:39 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.921s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Deleted volume successfully. Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0a21a06-bdc0-4487-b7e8-20283d114661 tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-a9d9bd0e-2a0b-46e9-aa26-2eb643a85a16-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "cinder-508294e6-5c26-4314-9238-936fb266bc1d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:39 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8.b28ab8b9-ba59-4798-b637-88a99c0f6b9f" returned: 0 in 0.841s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-b28ab8b9-ba59-4798-b637-88a99c0f6b9f" released by "_delete_snapshot" :: held 4.203s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:39 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-508294e6-5c26-4314-9238-936fb266bc1d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 1073741824" returned: 0 in 1.318s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-9f35f08f-3d8a-4783-8f5e-307db7395bb8" released by "delete_snapshot" :: held 4.248s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "cinder-quobyte-508294e6-5c26-4314-9238-936fb266bc1d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-quobyte-508294e6-5c26-4314-9238-936fb266bc1d" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:39 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 Jul 07 22:31:39 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4fdf69-64fc-475c-b6f4-fbe693573c13]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Created reservations ['20a8f0f7-c67e-48f7-a73c-60c34f3b16cd', '3f44a14b-fbe4-4793-84ca-188daa2eea48', '9c2bde1a-d84e-4c82-8a64-fe30351c0814', '90718a43-14a7-43f4-b426-8bc2fffd40bb'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:39 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d Jul 07 22:31:39 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Delete snapshot completed successfully. Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-b28ab8b9-ba59-4798-b637-88a99c0f6b9f-delete_snapshot" released by "delete_snapshot" :: held 4.625s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Snapshots deleted, issuing volume delete {{(pid=87612) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 22:31:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-9f35f08f-3d8a-4783-8f5e-307db7395bb8" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-9f35f08f-3d8a-4783-8f5e-307db7395bb8" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[940060e0-12ad-4dcc-a011-9118a7627ed1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:40 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 Jul 07 22:31:40 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:40 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1" returned: 0 in 0.863s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] <== create_volume: return (2316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.319s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3dd328-d118-47ba-a963-5e7a050c7ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d20050f-feb5-4c43-8e64-0ca2ffbdd005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:40 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Volume volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 (c1f76bc3-6ae4-409d-b422-c1378276ddc1): created successfully Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d20050f-feb5-4c43-8e64-0ca2ffbdd005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Flow 'volume_create_manager' (769d0409-4890-40eb-8990-df71d77241a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-7a4900f3-6e85-4753-8b5c-f2592ada8112 req-5bd28247-7d90-474b-8ca9-2493d34d8f72 tempest-VolumesSnapshotsTestJSON-1103242113 None] Created volume successfully. Jul 07 22:31:40 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d" returned: 0 in 1.044s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:40 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d Jul 07 22:31:40 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:41 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8" returned: 0 in 1.042s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:41 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8 Jul 07 22:31:41 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:41 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-508294e6-5c26-4314-9238-936fb266bc1d" returned: 0 in 0.803s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-quobyte-508294e6-5c26-4314-9238-936fb266bc1d" released by "delete_volume" :: held 1.923s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Created reservations ['e26cc516-6335-4663-91ff-9d77edf9d556', 'dd49ea7c-2c0b-44f6-8563-e583a9130814', '8d1e91d1-4b78-40cf-9525-9cca2be6fa2d', 'c11004a9-44b7-46a1-a9be-f0a5541fc459'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:42 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9f35f08f-3d8a-4783-8f5e-307db7395bb8" returned: 0 in 0.898s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:42 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:42 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Creating offline snapshot 32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 of volume c1f76bc3-6ae4-409d-b422-c1378276ddc1 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-9f35f08f-3d8a-4783-8f5e-307db7395bb8" released by "delete_volume" :: held 2.044s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2be17e-7d95-4282-8683-640227af562e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Created reservations ['96b8c26c-6db8-445e-9c39-f98bfd8a959e', '440e7560-ca39-4c41-abeb-d627b8b5e434', 'c8fe9597-9798-4aba-9f71-3c87872b00dd', 'b69bd71b-91c1-4c76-b013-324cfda50dc9'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:42 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 Jul 07 22:31:42 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:42 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:42 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:42 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.843s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:42 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Deleted volume successfully. Jul 07 22:31:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-343d178d-e846-47ed-ae71-5fc1f3a1a141 tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-508294e6-5c26-4314-9238-936fb266bc1d-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:43 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1" returned: 0 in 1.282s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "cinder-quobyte-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:43 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.009s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:43 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 1G Jul 07 22:31:43 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Deleted volume successfully. Jul 07 22:31:43 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" acquired by "delete_volume" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "cinder-e10c9eb6-8da9-49e8-85b1-7577533f3c47-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[66647e47-2978-43bf-b981-3e3f42cc8113]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-73a952d4-c56c-42a3-802f-da96aca85859 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-9f35f08f-3d8a-4783-8f5e-307db7395bb8-delete_volume" released by "delete_volume" :: held 8.267s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-e10c9eb6-8da9-49e8-85b1-7577533f3c47-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "cinder-quobyte-e10c9eb6-8da9-49e8-85b1-7577533f3c47" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-quobyte-e10c9eb6-8da9-49e8-85b1-7577533f3c47" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34a16dc-320a-482e-b18b-b9497028ceed]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:43 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 Jul 07 22:31:43 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:43 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 Jul 07 22:31:43 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:44 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 1G" returned: 0 in 1.084s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:44 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 Jul 07 22:31:44 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:44 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" returned: 0 in 1.063s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:44 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47" returned: 0 in 0.958s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:44 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06 Jul 07 22:31:44 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:44 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47 Jul 07 22:31:44 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:45 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9" returned: 0 in 0.866s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:45 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 is being set with open permissions: ugo+rw Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:45 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 Jul 07 22:31:45 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:45 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e10c9eb6-8da9-49e8-85b1-7577533f3c47" returned: 0 in 0.808s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-quobyte-e10c9eb6-8da9-49e8-85b1-7577533f3c47" released by "delete_volume" :: held 1.832s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:45 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" returned: 0 in 0.882s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-quobyte-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06" released by "delete_volume" :: held 2.024s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Created reservations ['b70aa6f4-0350-44e0-a6ee-2e05f81a7acd', '39ee4b43-39ad-4d03-8c62-a37315fa0efe', '869aceba-ed65-44cb-a443-eeeabb141537', 'a1d10a01-1506-4943-b5cf-2db8564f930d'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Created reservations ['e4059a33-b6b8-4b85-9575-a8a2524f8f34', 'adcc4a33-43b4-44a6-95d8-6a3380a83af4', 'fbb58168-fd76-4e83-9f39-d4beea5a1b58', 'd2369bee-ae9f-4ddd-85ca-d3b382b0ca91'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:45 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:45 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:45 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:45 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:46 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9" returned: 0 in 0.847s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:46 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.info Jul 07 22:31:46 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:46 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.895s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:46 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:46 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Deleted volume successfully. Jul 07 22:31:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8a9cb195-06a7-4654-b5a5-f8d9f1803af5 tempest-VolumesDeleteCascade-613047038 None] Lock "cinder-28ba5405-c9d3-42d3-b27a-c5bb1cab9c06-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:46 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.214s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:46 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:46 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Deleted volume successfully. Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f867f6ae-852b-4e72-bf6e-6513bcaf412b tempest-AttachVolumeNegativeTest-27436603 None] Lock "cinder-e10c9eb6-8da9-49e8-85b1-7577533f3c47-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:47 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.info" returned: 0 in 0.924s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:47 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.info is being set with open permissions: ugo+rw Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:47 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.info Jul 07 22:31:47 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Flow 'volume_create_manager' (55fc4261-4407-4ace-9010-1551e7af7eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e0e8cb-efef-4542-8465-da78046e6d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e0e8cb-efef-4542-8465-da78046e6d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-476467823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d69215-c10a-4dd5-8b7a-68e8b218e444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297cae58448a4408a9b87d2767f2396b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:48Z,use_quota=True,user_id='c27b2e43fb1246aa8397d5aa4fc98498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e7fa97-9ced-44fd-8770-57e878ef1b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e7fa97-9ced-44fd-8770-57e878ef1b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d707556-8d51-4cd6-9464-90c325d2e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d707556-8d51-4cd6-9464-90c325d2e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d69215-c10a-4dd5-8b7a-68e8b218e444', 'volume_name': 'volume-11d69215-c10a-4dd5-8b7a-68e8b218e444', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba34266-f6ba-4040-84e5-a70304843d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba34266-f6ba-4040-84e5-a70304843d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ce932b-fa48-4d6d-9165-2601bac0e534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:47 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Volume 11d69215-c10a-4dd5-8b7a-68e8b218e444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d69215-c10a-4dd5-8b7a-68e8b218e444', 'volume_size': 1} Jul 07 22:31:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:48 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.info" returned: 0 in 0.908s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.059s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-476467823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d69215-c10a-4dd5-8b7a-68e8b218e444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297cae58448a4408a9b87d2767f2396b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:48Z,use_quota=True,user_id='c27b2e43fb1246aa8397d5aa4fc98498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Creating volume 11d69215-c10a-4dd5-8b7a-68e8b218e444 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:31:48 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:31:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:48 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 1073741824 Jul 07 22:31:48 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-f501d3d0-96a2-4019-bff2-465fbbc23a67 req-074c7d2c-cae9-4a6b-bd89-964fde26c071 tempest-VolumesSnapshotsTestJSON-1103242113 None] Create snapshot completed successfully Jul 07 22:31:49 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 1073741824" returned: 0 in 1.097s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "cinder-32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "cinder-quobyte-c1f76bc3-6ae4-409d-b422-c1378276ddc1" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-quobyte-c1f76bc3-6ae4-409d-b422-c1378276ddc1" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "cinder-quobyte-32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-quobyte-32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:49 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 Jul 07 22:31:49 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Deleting offline snapshot 32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 of volume c1f76bc3-6ae4-409d-b422-c1378276ddc1 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] snapshot_file for this snap is: volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a8e600-5efb-4aa4-8bd5-1fabc216d313]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:49 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 Jul 07 22:31:49 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:50 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444" returned: 0 in 0.898s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ce932b-fa48-4d6d-9165-2601bac0e534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d69215-c10a-4dd5-8b7a-68e8b218e444', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33a6c8c-6ebf-4706-a7ad-7bf16848d4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:50 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Volume volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 (11d69215-c10a-4dd5-8b7a-68e8b218e444): created successfully Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33a6c8c-6ebf-4706-a7ad-7bf16848d4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Flow 'volume_create_manager' (55fc4261-4407-4ace-9010-1551e7af7eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:50 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9" returned: 0 in 0.953s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:31:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-937280ea-da42-427c-ae1b-e5a5c5b245db tempest-VolumesServicesTestJSON-855376602 None] Created volume successfully. Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[badb5bb1-6e2f-44d2-8d47-4c88ae4586f4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:50 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 Jul 07 22:31:50 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Flow 'volume_create_manager' (13a4cd2d-35c8-43d5-af7e-82b9e72e3874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15444ede-211d-4c9d-b90c-4181ce090742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15444ede-211d-4c9d-b90c-4181ce090742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2081284787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871fff3cf724413a87dd8307f6a4f9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:51Z,use_quota=True,user_id='d807add96826411fa2b51ade92252579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b46aea-6666-4c94-bbab-692b53ef1b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b46aea-6666-4c94-bbab-692b53ef1b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b594152-331c-4176-88f2-9ac46e65f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b594152-331c-4176-88f2-9ac46e65f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b', 'volume_name': 'volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1449d2c6-228c-4892-b02d-84c05d92525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1449d2c6-228c-4892-b02d-84c05d92525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a269ba-b3f4-4d13-8e71-d7dd8621fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:50 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Volume 1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b', 'volume_size': 1} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2081284787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871fff3cf724413a87dd8307f6a4f9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:51Z,use_quota=True,user_id='d807add96826411fa2b51ade92252579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Creating volume 1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:31:50 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:31:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:50 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b 1073741824 Jul 07 22:31:50 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Acquiring lock "cinder-11d69215-c10a-4dd5-8b7a-68e8b218e444-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Lock "cinder-11d69215-c10a-4dd5-8b7a-68e8b218e444-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Acquiring lock "cinder-quobyte-11d69215-c10a-4dd5-8b7a-68e8b218e444" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Lock "cinder-quobyte-11d69215-c10a-4dd5-8b7a-68e8b218e444" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:51 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1" returned: 0 in 1.168s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:51 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acc4d9e-520c-4420-8470-5253d779dc69]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:51 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 Jul 07 22:31:51 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:51 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 Jul 07 22:31:51 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:52 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b 1073741824" returned: 0 in 1.389s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:52 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b Jul 07 22:31:52 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:52 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9" returned: 0 in 1.066s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:52 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9 Jul 07 22:31:52 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:52 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444" returned: 0 in 1.256s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:52 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444 Jul 07 22:31:52 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:53 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b" returned: 0 in 0.832s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a269ba-b3f4-4d13-8e71-d7dd8621fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c350095f-feb3-4b92-8381-df98cc6f1eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:31:53 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Volume volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b (1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b): created successfully Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c350095f-feb3-4b92-8381-df98cc6f1eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Flow 'volume_create_manager' (13a4cd2d-35c8-43d5-af7e-82b9e72e3874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:31:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c0bfe7f8-d703-4f2a-b237-2a1e08c0202f tempest-VolumesMetadataTest-1593598240 None] Created volume successfully. Jul 07 22:31:53 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1.32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9" returned: 0 in 0.860s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-quobyte-32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9" released by "_delete_snapshot" :: held 4.210s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-quobyte-c1f76bc3-6ae4-409d-b422-c1378276ddc1" released by "delete_snapshot" :: held 4.243s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.quota [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Created reservations ['d885970e-9f92-454a-a830-09c59c7ad9d1', '8007e019-919c-4529-a47f-6467f324d06c', '8879072a-c7fb-4af6-a205-ad5d62ed5878', 'f93d09ea-86f8-423d-8b80-2c2a4fa0d84f'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Delete snapshot completed successfully. Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-614506f2-61df-4141-9a47-f68abb718f51 req-44cd3d38-0623-46e9-9ad1-eeb49c5768ab tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-32e0de5a-dd9d-4a8c-8f3d-c99815a6ddd9-delete_snapshot" released by "delete_snapshot" :: held 4.501s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "cinder-c1f76bc3-6ae4-409d-b422-c1378276ddc1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:53 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-11d69215-c10a-4dd5-8b7a-68e8b218e444" returned: 0 in 1.035s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Lock "cinder-quobyte-11d69215-c10a-4dd5-8b7a-68e8b218e444" released by "delete_volume" :: held 2.372s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-c1f76bc3-6ae4-409d-b422-c1378276ddc1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "cinder-quobyte-c1f76bc3-6ae4-409d-b422-c1378276ddc1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-quobyte-c1f76bc3-6ae4-409d-b422-c1378276ddc1" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Created reservations ['440ef7c2-2371-45e1-bdef-ffe8cff9d800', '8e39618b-2ffa-44bf-8ede-35878e69c03c', '201a1ed8-20d3-4f80-92c5-b2cca35a7d77', '711ac795-3185-42dc-8b8b-54cea0d47df5'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcaac4f-6d29-4879-9097-f25e41700cb3]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:54 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 Jul 07 22:31:54 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:54 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:54 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Acquiring lock "cinder-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Lock "cinder-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:55 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1" returned: 0 in 1.179s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:55 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:55 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1 Jul 07 22:31:55 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.093s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:55 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Deleted volume successfully. Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Acquiring lock "cinder-quobyte-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-95f15e6c-f2d3-498c-85a1-e8ca16f5bc3d tempest-VolumesServicesTestJSON-855376602 None] Lock "cinder-11d69215-c10a-4dd5-8b7a-68e8b218e444-delete_volume" released by "delete_volume" :: held 3.963s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Lock "cinder-quobyte-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b" acquired by "delete_volume" :: waited 0.047s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa24fa20-2c7e-4a1d-b5d3-3c934e0da99a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:55 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b Jul 07 22:31:55 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:55 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:55 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:56 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c1f76bc3-6ae4-409d-b422-c1378276ddc1" returned: 0 in 1.056s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-quobyte-c1f76bc3-6ae4-409d-b422-c1378276ddc1" released by "delete_volume" :: held 2.353s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG cinder.quota [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Created reservations ['0b167dc7-892b-4e72-8c87-d4905b3130a2', '02bb1946-41eb-40b7-ace2-0e6b2d515924', '0891e191-a2f5-4359-ae18-3d0873a88210', '0f2090d3-9531-4521-a9a9-ad6741586f25'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:56 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:56 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:56 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b" returned: 0 in 1.271s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:56 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b Jul 07 22:31:56 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:56 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.121s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 9 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:31:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:31:57 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.945s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG cinder.manager [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:57 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Deleted volume successfully. Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-f48e001b-8fd9-4c15-b6ec-200ed4d1a13e req-46471625-4651-4da2-a62e-ca916eafdc39 tempest-VolumesSnapshotsTestJSON-1103242113 None] Lock "cinder-c1f76bc3-6ae4-409d-b422-c1378276ddc1-delete_volume" released by "delete_volume" :: held 3.778s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:57 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b" returned: 0 in 1.064s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Lock "cinder-quobyte-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b" released by "delete_volume" :: held 2.402s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Created reservations ['549e3c10-b31c-49ba-bc88-6a9dbfad7992', '1150a1eb-06ef-4d47-bfb0-90d0f4ce8dd1', '9f85a4ba-01f7-4311-84d7-2eb19b84cf5f', 'a960def4-6659-4308-bc1f-485eb42f6643'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:31:57 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a5f1674b-8b46-4184-94d4-3e82decddf70 tempest-GroupSnapshotsV319Test-813833231 None] Group tempest-GroupSnapshotsV319Test-Group-1065369709: creating Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:31:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:31:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:31:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:31:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:31:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a5f1674b-8b46-4184-94d4-3e82decddf70 tempest-GroupSnapshotsV319Test-813833231 None] Group tempest-GroupSnapshotsV319Test-Group-1065369709: created successfully Jul 07 22:31:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a5f1674b-8b46-4184-94d4-3e82decddf70 tempest-GroupSnapshotsV319Test-813833231 None] Create group completed successfully. Jul 07 22:31:58 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:31:58 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:31:58 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 07 22:31:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.871s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:31:58 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:31:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Deleted volume successfully. Jul 07 22:31:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-447d6b7d-d3d2-4e88-8b04-3a3b0a445d48 tempest-VolumesMetadataTest-1593598240 None] Lock "cinder-1f3bf0d7-e7e7-4b21-a2ec-99dc66233d2b-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Flow 'volume_create_manager' (0c03b6b8-b10e-4cc9-84e1-76cb5e085115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c78b069-3e2a-4f74-ad17-8f6a63c00050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c78b069-3e2a-4f74-ad17-8f6a63c00050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-973814986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35de7915-7030-42e6-99f3-f9d7e440bc3b,host='devstack@QuobyteHD#QuobyteHD',id=4ca91ea2-988f-488f-83e7-e550b3399d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e8d193f66142808461cf7b2df317ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:00Z,use_quota=True,user_id='5060becfcae44cb894a7843e1d931e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(904c6390-ab7b-4b1c-ac17-14dce6da0c1e),volume_type_id=904c6390-ab7b-4b1c-ac17-14dce6da0c1e)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e78f5e3-0605-47e2-bf73-55ec1d128d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e78f5e3-0605-47e2-bf73-55ec1d128d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f733e3-529d-465b-a59e-2985048f7e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f733e3-529d-465b-a59e-2985048f7e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca91ea2-988f-488f-83e7-e550b3399d1e', 'volume_name': 'volume-4ca91ea2-988f-488f-83e7-e550b3399d1e', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb86ce75-b08a-4820-a65f-eeb708a96a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb86ce75-b08a-4820-a65f-eeb708a96a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319e25e5-05e3-43e7-991b-e6999ccdb34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:00 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Volume 4ca91ea2-988f-488f-83e7-e550b3399d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca91ea2-988f-488f-83e7-e550b3399d1e', 'volume_size': 1} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35de7915-7030-42e6-99f3-f9d7e440bc3b,created_at=2026-07-07T20:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-973814986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35de7915-7030-42e6-99f3-f9d7e440bc3b,host='devstack@QuobyteHD#QuobyteHD',id=4ca91ea2-988f-488f-83e7-e550b3399d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e8d193f66142808461cf7b2df317ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:00Z,use_quota=True,user_id='5060becfcae44cb894a7843e1d931e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(904c6390-ab7b-4b1c-ac17-14dce6da0c1e),volume_type_id=904c6390-ab7b-4b1c-ac17-14dce6da0c1e)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Creating volume 4ca91ea2-988f-488f-83e7-e550b3399d1e {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:00 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:32:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:00 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e 1073741824 Jul 07 22:32:00 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:01 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e 1073741824" returned: 0 in 1.278s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:01 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e Jul 07 22:32:01 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:02 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e" returned: 0 in 0.857s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] <== create_volume: return (2202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319e25e5-05e3-43e7-991b-e6999ccdb34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca91ea2-988f-488f-83e7-e550b3399d1e', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d728a61-b50c-4e6b-9623-ac61abf527ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:02 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Volume volume-4ca91ea2-988f-488f-83e7-e550b3399d1e (4ca91ea2-988f-488f-83e7-e550b3399d1e): created successfully Jul 07 22:32:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d728a61-b50c-4e6b-9623-ac61abf527ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Flow 'volume_create_manager' (0c03b6b8-b10e-4cc9-84e1-76cb5e085115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-968b94b5-77b3-401c-b8b2-60a996da2fb9 tempest-GroupSnapshotsV319Test-813833231 None] Created volume successfully. Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Flow 'volume_create_manager' (f9fa13bd-0052-4ad4-b7e7-9a2842c03157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e720143-7569-467b-8114-3fcaa79b230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e720143-7569-467b-8114-3fcaa79b230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1834355539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d04427f-f772-4c61-b8fb-28ac336b0a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ad1f53b2b242e5b172e71f24a4b357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:04Z,use_quota=True,user_id='a072fd122b074e17ab402375d1119958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21139f7a-a2f3-49fb-99ca-0781592337b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21139f7a-a2f3-49fb-99ca-0781592337b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10451b98-79db-4bd2-ba1a-adbb023c2da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10451b98-79db-4bd2-ba1a-adbb023c2da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d04427f-f772-4c61-b8fb-28ac336b0a51', 'volume_name': 'volume-6d04427f-f772-4c61-b8fb-28ac336b0a51', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c486743-7b33-4fd6-b318-73b276456863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c486743-7b33-4fd6-b318-73b276456863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2fc595-1bfa-475a-9d5e-c74c0506cecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Volume 6d04427f-f772-4c61-b8fb-28ac336b0a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d04427f-f772-4c61-b8fb-28ac336b0a51', 'volume_size': 1} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1834355539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d04427f-f772-4c61-b8fb-28ac336b0a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ad1f53b2b242e5b172e71f24a4b357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:04Z,use_quota=True,user_id='a072fd122b074e17ab402375d1119958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Creating volume 6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:04 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:04 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] GroupSnapshot 922bcf2d-e0fc-41d4-b436-217b34189dfa: creating. Jul 07 22:32:04 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 1073741824 Jul 07 22:32:04 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Group snapshot 922bcf2d-e0fc-41d4-b436-217b34189dfa: creating. {{(pid=87612) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Flow 'volume_create_manager' (bedd050f-9513-4bff-882d-c3cf62217931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90821a11-44f6-4847-98f9-ce44fb1d329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90821a11-44f6-4847-98f9-ce44fb1d329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1309266615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f2b481-879e-4ce3-85ef-deec53a22b42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1f770ec6d544f8ea8e1f37d91d6d045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:05Z,use_quota=True,user_id='2096caa6133144b4a6b9d2b439828bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710d07b5-d3db-4763-8381-e574c96e6580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710d07b5-d3db-4763-8381-e574c96e6580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264decc9-0652-41f8-b8b5-c51c6aea305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264decc9-0652-41f8-b8b5-c51c6aea305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f2b481-879e-4ce3-85ef-deec53a22b42', 'volume_name': 'volume-74f2b481-879e-4ce3-85ef-deec53a22b42', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3060fd8c-336b-4551-a15e-84b8058f4821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3060fd8c-336b-4551-a15e-84b8058f4821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec91575-e18c-44f7-989c-64a30a667382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Volume 74f2b481-879e-4ce3-85ef-deec53a22b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f2b481-879e-4ce3-85ef-deec53a22b42', 'volume_size': 1} Jul 07 22:32:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:05 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 1073741824" returned: 0 in 1.033s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:05 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 Jul 07 22:32:05 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:06 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51" returned: 0 in 0.759s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.731s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2fc595-1bfa-475a-9d5e-c74c0506cecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d04427f-f772-4c61-b8fb-28ac336b0a51', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9278b70-3b63-4de4-8ea0-10b364feacbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Creating offline snapshot 238e1cb3-19c7-449e-8207-a05e99d715e6 of volume 4ca91ea2-988f-488f-83e7-e550b3399d1e {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:32:06 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Volume volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 (6d04427f-f772-4c61-b8fb-28ac336b0a51): created successfully Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9278b70-3b63-4de4-8ea0-10b364feacbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Flow 'volume_create_manager' (f9fa13bd-0052-4ad4-b7e7-9a2842c03157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[97acad76-3ba4-49df-8356-4b5f0438cc6c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:06 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-19972819-1c24-4a7e-9f09-7075083becbf tempest-VolumesCloneTest-432502046 None] Created volume successfully. Jul 07 22:32:06 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e Jul 07 22:32:06 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:07 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e" returned: 0 in 1.040s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:07 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 1G Jul 07 22:32:07 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Flow 'volume_create_manager' (26f8d43b-dde7-4c7a-9b42-36ed27c2c36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecdc65e-c10e-4ac6-a31c-d9d7eeb0146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecdc65e-c10e-4ac6-a31c-d9d7eeb0146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1883453096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810b7c23-d94b-4ee1-a4f7-f1ab5afaf206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ad1f53b2b242e5b172e71f24a4b357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6d04427f-f772-4c61-b8fb-28ac336b0a51,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:07Z,use_quota=True,user_id='a072fd122b074e17ab402375d1119958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b30473d-051c-4468-8eaa-1e5f3bcaabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b30473d-051c-4468-8eaa-1e5f3bcaabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74ec501-3c72-4f05-a28b-f01e80ac007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74ec501-3c72-4f05-a28b-f01e80ac007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '810b7c23-d94b-4ee1-a4f7-f1ab5afaf206', 'volume_name': 'volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206', 'volume_size': 2, 'source_volid': '6d04427f-f772-4c61-b8fb-28ac336b0a51', 'source_volstatus': 'available'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bc42f0-bcde-4e4f-8147-9f52cda2db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bc42f0-bcde-4e4f-8147-9f52cda2db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a31e952-36a8-4e49-bbe0-63de08d0faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Volume 810b7c23-d94b-4ee1-a4f7-f1ab5afaf206: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206', 'volume_size': 2, 'source_volid': '6d04427f-f772-4c61-b8fb-28ac336b0a51', 'source_volstatus': 'available'} Jul 07 22:32:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:08 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 1G" returned: 0 in 1.016s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ca91ea2-988f-488f-83e7-e550b3399d1e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:08 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ca91ea2-988f-488f-83e7-e550b3399d1e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 Jul 07 22:32:08 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:09 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ca91ea2-988f-488f-83e7-e550b3399d1e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6" returned: 0 in 0.825s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:09 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:32:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:09 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 Jul 07 22:32:09 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:09 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6" returned: 0 in 0.699s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:09 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.info Jul 07 22:32:09 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:10 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.info" returned: 0 in 0.718s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:10 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:32:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:10 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.info Jul 07 22:32:10 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:11 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.info" returned: 0 in 0.774s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.225s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.657s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1309266615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f2b481-879e-4ce3-85ef-deec53a22b42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1f770ec6d544f8ea8e1f37d91d6d045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:05Z,use_quota=True,user_id='2096caa6133144b4a6b9d2b439828bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Creating volume 74f2b481-879e-4ce3-85ef-deec53a22b42 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:11 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:32:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:11 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 1073741824 Jul 07 22:32:11 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6be902e3-27a4-493a-a7bb-841e1e026204 tempest-GroupSnapshotsV319Test-813833231 None] group_snapshot 922bcf2d-e0fc-41d4-b436-217b34189dfa: created successfully Jul 07 22:32:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] group_snapshot 922bcf2d-e0fc-41d4-b436-217b34189dfa: deleting Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] group_snapshot 922bcf2d-e0fc-41d4-b436-217b34189dfa: deleting {{(pid=87612) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Acquiring lock "cinder-quobyte-4ca91ea2-988f-488f-83e7-e550b3399d1e" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Lock "cinder-quobyte-4ca91ea2-988f-488f-83e7-e550b3399d1e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Acquiring lock "cinder-quobyte-238e1cb3-19c7-449e-8207-a05e99d715e6" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Lock "cinder-quobyte-238e1cb3-19c7-449e-8207-a05e99d715e6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Deleting offline snapshot 238e1cb3-19c7-449e-8207-a05e99d715e6 of volume 4ca91ea2-988f-488f-83e7-e550b3399d1e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] snapshot_file for this snap is: volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b16698e-f8f1-4659-a296-b4e89d33206d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:12 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 1073741824" returned: 0 in 1.074s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:12 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 Jul 07 22:32:12 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 Jul 07 22:32:12 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:12 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:13 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42" returned: 0 in 0.822s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.854s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:13 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Cloning volume 6d04427f-f772-4c61-b8fb-28ac336b0a51 to volume 810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 Jul 07 22:32:13 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec91575-e18c-44f7-989c-64a30a667382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f2b481-879e-4ce3-85ef-deec53a22b42', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1806c6-648c-43c1-aeca-c47bd20e4ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6" returned: 0 in 0.959s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ca91ea2-988f-488f-83e7-e550b3399d1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[631725c2-5732-475b-a384-a9a54fa8732c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Creating offline snapshot 4d0ed629-e9b8-414e-8559-eec7ac93799c of volume 6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:32:13 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Volume volume-74f2b481-879e-4ce3-85ef-deec53a22b42 (74f2b481-879e-4ce3-85ef-deec53a22b42): created successfully Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1806c6-648c-43c1-aeca-c47bd20e4ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Flow 'volume_create_manager' (bedd050f-9513-4bff-882d-c3cf62217931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b177a1-cfb7-4475-bd38-0282fad8ebf9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-b4deb81b-4011-4220-8fa9-6570cca36ea5 req-0321f219-f43d-46e0-bd4b-a78924fa61d9 tempest-VolumesGetTestJSON-1851054088 None] Created volume successfully. Jul 07 22:32:13 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e Jul 07 22:32:13 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:13 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 Jul 07 22:32:13 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:14 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e" returned: 0 in 1.017s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:14 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 Jul 07 22:32:14 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:14 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51" returned: 0 in 1.028s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:14 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c 1G Jul 07 22:32:14 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Acquiring lock "cinder-74f2b481-879e-4ce3-85ef-deec53a22b42-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Lock "cinder-74f2b481-879e-4ce3-85ef-deec53a22b42-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Acquiring lock "cinder-quobyte-74f2b481-879e-4ce3-85ef-deec53a22b42" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Lock "cinder-quobyte-74f2b481-879e-4ce3-85ef-deec53a22b42" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba48c7a-d75c-4846-8f39-5178b2a55383]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:15 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 Jul 07 22:32:15 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:15 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6" returned: 0 in 1.064s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:15 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6 Jul 07 22:32:15 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:15 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c 1G" returned: 0 in 1.164s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:15 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c Jul 07 22:32:15 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:16 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42" returned: 0 in 0.917s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:16 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42 Jul 07 22:32:16 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:16 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e.238e1cb3-19c7-449e-8207-a05e99d715e6" returned: 0 in 0.887s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Lock "cinder-quobyte-238e1cb3-19c7-449e-8207-a05e99d715e6" released by "_delete_snapshot" :: held 4.068s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Lock "cinder-quobyte-4ca91ea2-988f-488f-83e7-e550b3399d1e" released by "delete_snapshot" :: held 4.107s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:16 devstack cinder-volume[87612]: WARNING cinder.quota [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1485809707 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1485809707, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:32:16 devstack cinder-volume[87612]: WARNING cinder.quota [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1485809707 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1485809707, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] Created reservations ['4e5d875a-79e8-42ab-ab9f-b4f568394a9a', 'ac9c80db-6403-4cd1-9f5f-df4d84d9a632', 'a020f795-af67-4b77-b675-e2541af428d9', '345a4f71-9dc1-4cc0-aa8c-9be525409b89'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:16 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c" returned: 0 in 1.013s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:16 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c is being set with open permissions: ugo+rw Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:16 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9803e74b-c3b3-4da0-a14a-29b45d831a61 tempest-GroupSnapshotsV319Test-813833231 None] group_snapshot 922bcf2d-e0fc-41d4-b436-217b34189dfa: deleted successfully Jul 07 22:32:16 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c Jul 07 22:32:16 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Flow 'volume_create_manager' (e8663843-862b-4825-8d90-5b72d3517fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20eb3d2-6cf7-44af-8d97-408f65740cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20eb3d2-6cf7-44af-8d97-408f65740cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1099907900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b82cfb9-8b21-4181-891a-14287f2a20e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d4cb4de24b49cfadae8cb4205f87fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:17Z,use_quota=True,user_id='8aceb8a584164c5aae2901708264f56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147e2c9a-262f-4dca-8cd8-025cc7a94876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147e2c9a-262f-4dca-8cd8-025cc7a94876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c5c3ed-d278-43b7-9384-4fe240f1d527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:32:17 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-74f2b481-879e-4ce3-85ef-deec53a22b42" returned: 0 in 0.922s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Lock "cinder-quobyte-74f2b481-879e-4ce3-85ef-deec53a22b42" released by "delete_volume" :: held 1.896s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.quota [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Created reservations ['8bf8d52d-bb94-4345-abb2-7cb2d2065009', '68cb58ae-17bd-4b97-ac7d-fb0a7da30ed7', '334a2e96-77db-4089-8d5d-d1a605b33702', '129016fd-c78c-4633-8a92-d8a8f91ecce6'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Acquiring lock "cinder-quobyte-4ca91ea2-988f-488f-83e7-e550b3399d1e" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Lock "cinder-quobyte-4ca91ea2-988f-488f-83e7-e550b3399d1e" acquired by "delete_volume" :: waited 0.044s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7525bf-73d8-4010-a7b5-99c7ddfd3452]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:17 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:32:17 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:17 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e Jul 07 22:32:17 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:17 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c" returned: 0 in 0.970s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:17 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.info Jul 07 22:32:17 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c5c3ed-d278-43b7-9384-4fe240f1d527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b82cfb9-8b21-4181-891a-14287f2a20e6', 'volume_name': 'volume-8b82cfb9-8b21-4181-891a-14287f2a20e6', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba611ffe-96f6-4836-9ba5-77fd2f40905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba611ffe-96f6-4836-9ba5-77fd2f40905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3e96df-211a-4be4-ae38-15a16a32cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:17 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Volume 8b82cfb9-8b21-4181-891a-14287f2a20e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b82cfb9-8b21-4181-891a-14287f2a20e6', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:32:17 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Trying to clone 8b82cfb9-8b21-4181-891a-14287f2a20e6 from image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:32:18 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964089f-2603-4423-b241-8a7dc0784019]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:18 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.142s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG cinder.manager [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:18 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Deleted volume successfully. Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-92ea852d-d026-4e84-bf04-31d3183f66ae req-1a06b3fb-63dc-419c-88ba-4f814ca42a30 tempest-VolumesGetTestJSON-1851054088 None] Lock "cinder-74f2b481-879e-4ce3-85ef-deec53a22b42-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:18 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e" returned: 0 in 1.279s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:18 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e Jul 07 22:32:18 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:18 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD Jul 07 22:32:18 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:18 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.info" returned: 0 in 1.211s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:18 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.info is being set with open permissions: ugo+rw Jul 07 22:32:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:18 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.info Jul 07 22:32:18 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:19 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4ca91ea2-988f-488f-83e7-e550b3399d1e" returned: 0 in 1.011s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:19 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Lock "cinder-quobyte-4ca91ea2-988f-488f-83e7-e550b3399d1e" released by "delete_volume" :: held 2.421s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD" returned: 0 in 1.124s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Temporary image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 is fetched for user 8aceb8a584164c5aae2901708264f56a. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Created reservations ['ed166f9d-16eb-454e-a12f-e2078b0b0a9c'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1413b3-fe51-464c-a93b-e7f7cf4677a4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:19 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.info" returned: 0 in 0.920s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Acquiring lock "cinder-quobyte-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:19 devstack cinder-volume[87612]: WARNING cinder.quota [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1485809707 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1485809707, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Lock "cinder-quobyte-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] snapshot: 4d0ed629-e9b8-414e-8559-eec7ac93799c, volume: 810b7c23-d94b-4ee1-a4f7-f1ab5afaf206, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:19 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD Jul 07 22:32:19 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Created reservations ['7c6dc946-31ae-4522-b00f-1a72e87d3f63', '3ba00f4d-e00c-4f4d-8623-97c10dee348d', '424fc285-845c-4f80-ba42-0a932009207d', '358002ad-3c76-4779-805a-15863d2aedf3'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaacb3a-f998-414b-bcf2-06b0f6d262a1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:20 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c Jul 07 22:32:20 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:20 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:32:20 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:20 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD" returned: 0 in 0.939s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:21 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.770s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:21 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:21 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e9d2a903-43ee-4a9c-ad72-c06e1a8bfaa9 tempest-GroupSnapshotsV319Test-813833231 None] Delete group completed successfully. Jul 07 22:32:21 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c" returned: 0 in 1.066s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d04427f-f772-4c61-b8fb-28ac336b0a51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:32:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:32:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:32:21 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed835189-6fec-4c7a-b9af-2ba90fcc893b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:21 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 Jul 07 22:32:21 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:22 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51" returned: 0 in 1.039s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:22 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:32:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:22 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 Jul 07 22:32:22 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Flow 'volume_create_manager' (92042eaa-8d43-4c36-b762-b33301567245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e1198c-7cde-48de-a90a-52091f8b56b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e1198c-7cde-48de-a90a-52091f8b56b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-766051826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9182f8dc-78a5-4a17-a060-3d46324050fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='190f1a5dabd84ebb8157e04e8950c924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:23Z,use_quota=True,user_id='25396473ac734f6783d5773c62184d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1cf0ab-a012-480d-b1f2-d20298069bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1cf0ab-a012-480d-b1f2-d20298069bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc792da-b219-4656-af4f-ab9f89569c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc792da-b219-4656-af4f-ab9f89569c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9182f8dc-78a5-4a17-a060-3d46324050fa', 'volume_name': 'volume-9182f8dc-78a5-4a17-a060-3d46324050fa', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fc72d6-a5e5-4566-910d-e6a6b130d865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fc72d6-a5e5-4566-910d-e6a6b130d865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e06ed68-66cb-4262-8cc8-f3826ce3025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:23 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Volume 9182f8dc-78a5-4a17-a060-3d46324050fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9182f8dc-78a5-4a17-a060-3d46324050fa', 'volume_size': 1} Jul 07 22:32:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:27 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" returned: 0 in 5.512s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:27 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c2a8f-b15b-4449-9111-ae699aa81bbd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:27 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 Jul 07 22:32:27 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:28 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51" returned: 0 in 1.080s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:28 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:32:28 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Converted 1024.00 MB image at 185.74 MB/s Jul 07 22:32:28 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 is being set with open permissions: ugo+rw Jul 07 22:32:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:28 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 Jul 07 22:32:28 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:29 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" returned: 0 in 0.727s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Lock "cinder-quobyte-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" released by "_copy_volume_from_snapshot" :: held 9.572s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Acquiring lock "cinder-quobyte-4d0ed629-e9b8-414e-8559-eec7ac93799c" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Lock "cinder-quobyte-4d0ed629-e9b8-414e-8559-eec7ac93799c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Deleting offline snapshot 4d0ed629-e9b8-414e-8559-eec7ac93799c of volume 6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:32:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] snapshot_file for this snap is: volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:32:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[435a6e39-c12c-4e16-991f-2965a8b7d744]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:29 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c Jul 07 22:32:29 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:30 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c" returned: 0 in 0.968s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d04427f-f772-4c61-b8fb-28ac336b0a51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:32:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3234ed65-b04c-4d0b-8d8b-59f25cc2538c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:30 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 Jul 07 22:32:30 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:31 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51" returned: 0 in 0.980s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:31 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c Jul 07 22:32:31 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:32 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c" returned: 0 in 0.927s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:32 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c Jul 07 22:32:32 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=109,cinder:INSERT=32,cinder:UPDATE=121,cinder:DELETE=7 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:32:33 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51.4d0ed629-e9b8-414e-8559-eec7ac93799c" returned: 0 in 0.800s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Lock "cinder-quobyte-4d0ed629-e9b8-414e-8559-eec7ac93799c" released by "_delete_snapshot" :: held 3.797s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.030s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.625s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1099907900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b82cfb9-8b21-4181-891a-14287f2a20e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d4cb4de24b49cfadae8cb4205f87fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:17Z,use_quota=True,user_id='8aceb8a584164c5aae2901708264f56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Creating volume 8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:33 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a31e952-36a8-4e49-bbe0-63de08d0faf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206', 'volume_size': 2, 'source_volid': '6d04427f-f772-4c61-b8fb-28ac336b0a51', 'source_volstatus': 'available'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:33 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 1073741824 Jul 07 22:32:33 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b741cff0-5faa-4a65-ae28-ab20775b0049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:33 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Volume volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 (810b7c23-d94b-4ee1-a4f7-f1ab5afaf206): created successfully Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b741cff0-5faa-4a65-ae28-ab20775b0049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Flow 'volume_create_manager' (26f8d43b-dde7-4c7a-9b42-36ed27c2c36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-bc74e4d5-2ddc-4f57-96e9-46595e8115bb tempest-VolumesCloneTest-432502046 None] Created volume successfully. Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Acquiring lock "cinder-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Lock "cinder-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Acquiring lock "cinder-quobyte-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Lock "cinder-quobyte-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:34 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a1280c-70d3-4c29-8c35-4dee06d9583a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:34 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 Jul 07 22:32:34 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:34 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 1073741824" returned: 0 in 1.197s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:34 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 Jul 07 22:32:34 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:35 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" returned: 0 in 0.978s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:35 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206 Jul 07 22:32:35 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:35 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6" returned: 0 in 0.882s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.223s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-766051826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9182f8dc-78a5-4a17-a060-3d46324050fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='190f1a5dabd84ebb8157e04e8950c924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:23Z,use_quota=True,user_id='25396473ac734f6783d5773c62184d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Creating volume 9182f8dc-78a5-4a17-a060-3d46324050fa {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:35 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:35 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa 1073741824 Jul 07 22:32:35 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=96,cinder:UPDATE=133,cinder:INSERT=34,cinder:DELETE=10 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Attempting download of 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}])) to volume 8b82cfb9-8b21-4181-891a-14287f2a20e6. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0336a7f9-e3c4-4d73-8dd7-c2cd5aa50aab]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_5_p3zyg0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:35 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" returned: 0 in 0.825s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:35 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_5_p3zyg0 Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Lock "cinder-quobyte-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206" released by "delete_volume" :: held 1.872s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:35 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:35 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Created reservations ['e7f1193c-d151-4b07-9642-8c371d696ff4', '74200f9d-5614-4ef2-bb12-3cbfea7a3a6a', '481f8839-4e9d-4027-9043-41ca2ea638a7', '7242ebd1-3d36-4a57-a165-686d51b866bb'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:36 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:32:36 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:36 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c9825aa5-0328-47fb-b8eb-f27bfb1f6146 tempest-GroupsV314Test-1987471961 None] Group tempest-GroupsV314Test-Group-1749506417: creating Jul 07 22:32:36 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c9825aa5-0328-47fb-b8eb-f27bfb1f6146 tempest-GroupsV314Test-1987471961 None] Group tempest-GroupsV314Test-Group-1749506417: created successfully Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Acquiring lock "cinder-6d04427f-f772-4c61-b8fb-28ac336b0a51-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:36 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c9825aa5-0328-47fb-b8eb-f27bfb1f6146 tempest-GroupsV314Test-1987471961 None] Create group completed successfully. Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Lock "cinder-6d04427f-f772-4c61-b8fb-28ac336b0a51-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Acquiring lock "cinder-quobyte-6d04427f-f772-4c61-b8fb-28ac336b0a51" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Lock "cinder-quobyte-6d04427f-f772-4c61-b8fb-28ac336b0a51" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e60bec8-c7dc-4565-a810-44313e6e9a97]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:36 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 Jul 07 22:32:36 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:36 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_5_p3zyg0" returned: 0 in 1.118s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_5_p3zyg0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:36 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa 1073741824" returned: 0 in 1.285s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:36 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa Jul 07 22:32:36 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:36 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_5_p3zyg0 Jul 07 22:32:36 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:37 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.971s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Deleted volume successfully. Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a5e680f2-c03f-47ee-9de9-dd9cc06b2e76 tempest-VolumesCloneTest-432502046 None] Lock "cinder-810b7c23-d94b-4ee1-a4f7-f1ab5afaf206-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:37 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51" returned: 0 in 1.074s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:37 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:37 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51 Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa" returned: 0 in 0.846s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:37 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e06ed68-66cb-4262-8cc8-f3826ce3025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9182f8dc-78a5-4a17-a060-3d46324050fa', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6b8b9c-f91b-4130-a475-dc2983113df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:37 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Volume volume-9182f8dc-78a5-4a17-a060-3d46324050fa (9182f8dc-78a5-4a17-a060-3d46324050fa): created successfully Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6b8b9c-f91b-4130-a475-dc2983113df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Flow 'volume_create_manager' (92042eaa-8d43-4c36-b762-b33301567245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9c9924c5-9f6a-4a64-bfe4-dc18c3db7a37 tempest-VolumesTestJSON-2107174243 None] Created volume successfully. Jul 07 22:32:37 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_5_p3zyg0" returned: 1 in 1.114s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_5_p3zyg0' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4672417c-1269-46c3-babc-5a18bb15da91]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:38 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD Jul 07 22:32:38 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Flow 'volume_create_manager' (58e64777-0020-4402-97b1-4f55869d44ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b707c44-7a6c-42ce-9277-756ae292f09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b707c44-7a6c-42ce-9277-756ae292f09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1285266505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dce8f7d7-573c-4443-8ff0-6db609c17805,host='devstack@QuobyteHD#QuobyteHD',id=48cca724-19ce-4db4-aff5-ad3663edca29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669f2b79a3634082b0aac4ba30e078ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:38Z,use_quota=True,user_id='d938a8a447dc4db6b74eaa6c6a46fb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a51f7712-3e56-4db9-8973-4fb2785f7f5c),volume_type_id=a51f7712-3e56-4db9-8973-4fb2785f7f5c)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ef7bbd-125d-444b-abaf-76c64841cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ef7bbd-125d-444b-abaf-76c64841cc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebb5dfe-59f4-4245-9d8a-76a6bff19ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebb5dfe-59f4-4245-9d8a-76a6bff19ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cca724-19ce-4db4-aff5-ad3663edca29', 'volume_name': 'volume-48cca724-19ce-4db4-aff5-ad3663edca29', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f135e2b7-d377-4e5b-b7dc-79b7181b59d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f135e2b7-d377-4e5b-b7dc-79b7181b59d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05786bc0-969b-4d97-95a5-5c034837b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:38 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Volume 48cca724-19ce-4db4-aff5-ad3663edca29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cca724-19ce-4db4-aff5-ad3663edca29', 'volume_size': 1} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dce8f7d7-573c-4443-8ff0-6db609c17805,created_at=2026-07-07T20:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1285266505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dce8f7d7-573c-4443-8ff0-6db609c17805,host='devstack@QuobyteHD#QuobyteHD',id=48cca724-19ce-4db4-aff5-ad3663edca29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669f2b79a3634082b0aac4ba30e078ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:38Z,use_quota=True,user_id='d938a8a447dc4db6b74eaa6c6a46fb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a51f7712-3e56-4db9-8973-4fb2785f7f5c),volume_type_id=a51f7712-3e56-4db9-8973-4fb2785f7f5c)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Creating volume 48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:38 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:38 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 1073741824 Jul 07 22:32:38 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:38 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6d04427f-f772-4c61-b8fb-28ac336b0a51" returned: 0 in 0.802s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Lock "cinder-quobyte-6d04427f-f772-4c61-b8fb-28ac336b0a51" released by "delete_volume" :: held 1.960s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Created reservations ['b5205242-8122-4f05-9a8a-938f7d6009bb', 'c0c14885-b423-4443-81b6-0450f7281262', 'b864f8f3-a5f6-4845-97d7-1970fca32e21', '7f676a86-a3ef-4aff-84d7-3fa11daf7761'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:38 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:32:38 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:39 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD" returned: 0 in 1.124s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 was qcow2, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:39 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 Jul 07 22:32:39 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:39 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Flow 'volume_create_manager' (8efafdca-3671-4515-9538-7663abed9cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93567d2c-01be-4794-9a9a-ce68a81ece10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 1073741824" returned: 0 in 1.297s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93567d2c-01be-4794-9a9a-ce68a81ece10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1776137085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52277195-e2b1-47af-8d6d-2d98ad34e135,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='190f1a5dabd84ebb8157e04e8950c924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:40Z,use_quota=True,user_id='25396473ac734f6783d5773c62184d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65f9ff6-d0e2-429e-9f8d-27ca3f3e22e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65f9ff6-d0e2-429e-9f8d-27ca3f3e22e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5294801e-9da0-40e3-9397-4ae0cb256f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5294801e-9da0-40e3-9397-4ae0cb256f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52277195-e2b1-47af-8d6d-2d98ad34e135', 'volume_name': 'volume-52277195-e2b1-47af-8d6d-2d98ad34e135', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea3b849-3c82-47ff-9c72-c61abb387565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea3b849-3c82-47ff-9c72-c61abb387565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8978e1-e3ac-4005-abaf-05355bdab7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:39 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Volume 52277195-e2b1-47af-8d6d-2d98ad34e135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52277195-e2b1-47af-8d6d-2d98ad34e135', 'volume_size': 1} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:39 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.107s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:39 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 Jul 07 22:32:39 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Deleted volume successfully. Jul 07 22:32:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc5a10d9-0fd3-42c0-8968-81bad00f5e4c tempest-VolumesCloneTest-432502046 None] Lock "cinder-6d04427f-f772-4c61-b8fb-28ac336b0a51-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:40 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29" returned: 0 in 1.052s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] <== create_volume: return (2474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.477s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1776137085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52277195-e2b1-47af-8d6d-2d98ad34e135,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='190f1a5dabd84ebb8157e04e8950c924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:40Z,use_quota=True,user_id='25396473ac734f6783d5773c62184d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Creating volume 52277195-e2b1-47af-8d6d-2d98ad34e135 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:40 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05786bc0-969b-4d97-95a5-5c034837b801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cca724-19ce-4db4-aff5-ad3663edca29', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddba589-fb68-4d24-9327-3868de15e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:40 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 1073741824 Jul 07 22:32:40 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:40 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Volume volume-48cca724-19ce-4db4-aff5-ad3663edca29 (48cca724-19ce-4db4-aff5-ad3663edca29): created successfully Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddba589-fb68-4d24-9327-3868de15e292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Flow 'volume_create_manager' (58e64777-0020-4402-97b1-4f55869d44ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-82756c95-52c3-49dc-ab09-43b305cb9280 tempest-GroupsV314Test-1987471961 None] Created volume successfully. Jul 07 22:32:42 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 1073741824" returned: 0 in 1.485s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:42 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6" returned: 0 in 3.315s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:42 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_mtyf98n5devstack@QuobyteHD, size 112.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:32:42 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Converted 112.00 MB image at 33.77 MB/s Jul 07 22:32:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:42 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 1G Jul 07 22:32:42 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:42 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 Jul 07 22:32:42 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:43 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135" returned: 0 in 0.820s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] <== create_volume: return (2377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8978e1-e3ac-4005-abaf-05355bdab7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52277195-e2b1-47af-8d6d-2d98ad34e135', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b95d1c2-173b-4cf2-85b0-344f1f6c42ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:43 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Volume volume-52277195-e2b1-47af-8d6d-2d98ad34e135 (52277195-e2b1-47af-8d6d-2d98ad34e135): created successfully Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b95d1c2-173b-4cf2-85b0-344f1f6c42ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:43 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Flow 'volume_create_manager' (8efafdca-3671-4515-9538-7663abed9cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 1G" returned: 0 in 1.072s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:43 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c8894844-dd5f-4bf3-828d-16264d697fe1 tempest-VolumesTestJSON-2107174243 None] Created volume successfully. Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Flow 'volume_create_manager' (51289209-c848-41d8-abbf-84a1299bc667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc4644f-861b-4d02-923f-d77c83e34f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d776e389-ea8d-4416-a04b-52362732e92c]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc4644f-861b-4d02-923f-d77c83e34f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-902275385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1baa13f-c24e-4fe4-a4f9-d61a3712379a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febacb84441a4f879cbfda793ca9213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:43Z,use_quota=True,user_id='7931f21c909b4938b5510980e77a4947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53826f7-b00f-479a-9c8b-cb523f4c5482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53826f7-b00f-479a-9c8b-cb523f4c5482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ae103e-a809-4317-85ce-f162f2dec3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ae103e-a809-4317-85ce-f162f2dec3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1baa13f-c24e-4fe4-a4f9-d61a3712379a', 'volume_name': 'volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a', 'volume_size': 2}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcee58f4-4bf7-4456-a538-eb61ba15f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcee58f4-4bf7-4456-a538-eb61ba15f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d585d8-4579-49fa-98a7-4b6112275cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:43 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Volume e1baa13f-c24e-4fe4-a4f9-d61a3712379a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a', 'volume_size': 2} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-902275385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1baa13f-c24e-4fe4-a4f9-d61a3712379a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febacb84441a4f879cbfda793ca9213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:43Z,use_quota=True,user_id='7931f21c909b4938b5510980e77a4947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Creating volume e1baa13f-c24e-4fe4-a4f9-d61a3712379a {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:32:43 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a 2147483648 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:43 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a 2147483648 Jul 07 22:32:43 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:43 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 Jul 07 22:32:43 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:44 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6" returned: 0 in 0.948s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:44 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 Jul 07 22:32:44 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:44 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a 2147483648" returned: 0 in 1.099s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:44 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a Jul 07 22:32:44 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Flow 'volume_create_manager' (40d2ef29-d377-4b04-9e58-beaaae8e247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cea4e1b-de25-4ba9-921c-dafe754b440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cea4e1b-de25-4ba9-921c-dafe754b440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-481010901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8345667-831c-49f2-b1d9-43267d908de3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='190f1a5dabd84ebb8157e04e8950c924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:45Z,use_quota=True,user_id='25396473ac734f6783d5773c62184d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7db481c-23d0-40d0-9f7f-416e7c0418cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7db481c-23d0-40d0-9f7f-416e7c0418cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e335367-d5f1-4520-b808-2e480b31e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e335367-d5f1-4520-b808-2e480b31e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8345667-831c-49f2-b1d9-43267d908de3', 'volume_name': 'volume-f8345667-831c-49f2-b1d9-43267d908de3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a34d39-2723-43e4-b7d9-2fcacf6a6256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a34d39-2723-43e4-b7d9-2fcacf6a6256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a2e50-6fec-4884-b980-37bdb2338786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:45 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Volume f8345667-831c-49f2-b1d9-43267d908de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8345667-831c-49f2-b1d9-43267d908de3', 'volume_size': 1} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:45 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6" returned: 1 in 0.920s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Downloaded image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}])) to volume 8b82cfb9-8b21-4181-891a-14287f2a20e6 successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Temporary image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 for user 8aceb8a584164c5aae2901708264f56a is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Marking volume 8b82cfb9-8b21-4181-891a-14287f2a20e6 as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Copying metadata from image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 to 8b82cfb9-8b21-4181-891a-14287f2a20e6. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Creating volume glance metadata for volume 8b82cfb9-8b21-4181-891a-14287f2a20e6 backed by image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:32:45 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.858s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:45 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Cloning volume 48cca724-19ce-4db4-aff5-ad3663edca29 to volume 1249dbfb-350e-44ba-8216-f1752685f823 Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3e96df-211a-4be4-ae38-15a16a32cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b82cfb9-8b21-4181-891a-14287f2a20e6', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468f1b28-269a-478f-b393-ac8b3a73889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d585d8-4579-49fa-98a7-4b6112275cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a', 'volume_size': 2}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ba690f-8b46-463d-b0d0-1bf1d7b2495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:45 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Volume volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 (8b82cfb9-8b21-4181-891a-14287f2a20e6): created successfully Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468f1b28-269a-478f-b393-ac8b3a73889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Flow 'volume_create_manager' (e8663843-862b-4825-8d90-5b72d3517fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Creating offline snapshot e8cfa3ee-8a27-4a9a-9119-37e9bd385706 of volume 48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:32:45 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Volume volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a (e1baa13f-c24e-4fe4-a4f9-d61a3712379a): created successfully Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ba690f-8b46-463d-b0d0-1bf1d7b2495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Flow 'volume_create_manager' (51289209-c848-41d8-abbf-84a1299bc667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5b353a-2248-4476-b67a-d315985fe1cd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4694accd-7393-4735-b9bc-93bc99b104f9 tempest-VolumesImageMetadata-1276686477 None] Created volume successfully. Jul 07 22:32:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-26b4a362-ad26-4e87-82dd-607bb5734ca8 tempest-VolumesCloneNegativeTest-505491263 None] Created volume successfully. Jul 07 22:32:45 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 Jul 07 22:32:45 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Acquiring lock "cinder-8b82cfb9-8b21-4181-891a-14287f2a20e6-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Lock "cinder-8b82cfb9-8b21-4181-891a-14287f2a20e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Acquiring lock "cinder-quobyte-8b82cfb9-8b21-4181-891a-14287f2a20e6" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Lock "cinder-quobyte-8b82cfb9-8b21-4181-891a-14287f2a20e6" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0939d5eb-7804-4536-982c-55e9c6b8e660]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:46 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 Jul 07 22:32:46 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:46 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29" returned: 0 in 0.903s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:46 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 1G Jul 07 22:32:46 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Acquiring lock "cinder-e1baa13f-c24e-4fe4-a4f9-d61a3712379a-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Lock "cinder-e1baa13f-c24e-4fe4-a4f9-d61a3712379a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Acquiring lock "cinder-quobyte-e1baa13f-c24e-4fe4-a4f9-d61a3712379a" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Lock "cinder-quobyte-e1baa13f-c24e-4fe4-a4f9-d61a3712379a" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:47 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cbe753-1f19-45e2-ae8f-d64f9dc60dcf]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:47 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a Jul 07 22:32:47 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:47 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6" returned: 0 in 0.917s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:47 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 Jul 07 22:32:47 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:47 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 1G" returned: 0 in 1.040s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cca724-19ce-4db4-aff5-ad3663edca29 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:47 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cca724-19ce-4db4-aff5-ad3663edca29 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 Jul 07 22:32:47 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:47 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a" returned: 0 in 0.908s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:47 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a Jul 07 22:32:47 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:48 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6" returned: 1 in 0.970s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:48 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6 Jul 07 22:32:48 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:48 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48cca724-19ce-4db4-aff5-ad3663edca29 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706" returned: 0 in 0.849s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:48 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:48 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 Jul 07 22:32:48 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:48 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1baa13f-c24e-4fe4-a4f9-d61a3712379a" returned: 0 in 0.804s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Lock "cinder-quobyte-e1baa13f-c24e-4fe4-a4f9-d61a3712379a" released by "delete_volume" :: held 1.792s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Created reservations ['1b0f7a1e-11f4-48ad-89f5-c09aa8e71cab', '54c65eb5-4344-4ed7-8a1a-f67364a9a6b7', 'c7fa5c29-01de-4985-8f0f-b1b4498c2844', '1d2c9da8-70d2-4e75-8a6e-45f9dce5a9ce'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:48 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:32:48 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:48 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8b82cfb9-8b21-4181-891a-14287f2a20e6" returned: 0 in 0.814s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Lock "cinder-quobyte-8b82cfb9-8b21-4181-891a-14287f2a20e6" released by "delete_volume" :: held 2.792s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Created reservations ['0d991a49-4a43-439c-afc2-288da584bdf2', 'b280887d-2146-4392-ad5c-447f19ade678', '9e7c394c-6596-43ee-8bdf-9011cb554af2', '8d9512e4-99b3-4576-8d6e-3427612e9ff5'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:49 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:32:49 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:49 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706" returned: 0 in 0.864s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:49 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.info Jul 07 22:32:49 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:49 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.044s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:49 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:49 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Deleted volume successfully. Jul 07 22:32:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-86fdb51f-3d48-4d2f-91a9-457a58160d44 tempest-VolumesCloneNegativeTest-505491263 None] Lock "cinder-e1baa13f-c24e-4fe4-a4f9-d61a3712379a-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:50 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.100s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:50 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Deleted volume successfully. Jul 07 22:32:50 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.info" returned: 0 in 0.979s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:50 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:32:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-acda7e68-d388-4d0f-88c9-10d14313e8e6 tempest-VolumesImageMetadata-1276686477 None] Lock "cinder-8b82cfb9-8b21-4181-891a-14287f2a20e6-delete_volume" released by "delete_volume" :: held 4.230s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:32:50 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.info Jul 07 22:32:50 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:51 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.info" returned: 0 in 0.868s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Acquiring lock "cinder-quobyte-1249dbfb-350e-44ba-8216-f1752685f823" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Lock "cinder-quobyte-1249dbfb-350e-44ba-8216-f1752685f823" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] snapshot: e8cfa3ee-8a27-4a9a-9119-37e9bd385706, volume: 1249dbfb-350e-44ba-8216-f1752685f823, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[638fc1c5-8ec5-4890-bfcb-54da53885cbd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:51 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 Jul 07 22:32:51 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:52 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706" returned: 0 in 0.916s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48cca724-19ce-4db4-aff5-ad3663edca29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:32:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:32:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:32:52 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b8a4e-b44d-44e3-9186-6aa7835dd35d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:52 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 Jul 07 22:32:52 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:53 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29" returned: 0 in 1.088s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:53 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 Jul 07 22:32:53 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Flow 'volume_create_manager' (45237e3a-e60a-41b1-8684-c430e3211d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db2e86e-9a16-4049-8df1-ddba0c013dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db2e86e-9a16-4049-8df1-ddba0c013dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1295292161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98568f7-9b07-44b9-a272-0cda9224d80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030a06154a94464aa0d29b5f13b57a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:54Z,use_quota=True,user_id='6385bf54954a458d9b27e355d5fe2c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fc3dd9-be5d-4c04-93f6-289f79d1c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fc3dd9-be5d-4c04-93f6-289f79d1c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19273c45-4d6a-4ba0-8d39-33ae30aaf901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19273c45-4d6a-4ba0-8d39-33ae30aaf901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98568f7-9b07-44b9-a272-0cda9224d80d', 'volume_name': 'volume-a98568f7-9b07-44b9-a272-0cda9224d80d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cd7343-eb90-40bb-9519-3118da146b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cd7343-eb90-40bb-9519-3118da146b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f834840-b3d0-4856-a5a4-0254b7e7939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:32:53 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Volume a98568f7-9b07-44b9-a272-0cda9224d80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98568f7-9b07-44b9-a272-0cda9224d80d', 'volume_size': 1} Jul 07 22:32:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:32:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:32:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:32:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:32:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:32:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:32:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:55 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:32:55 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:32:57 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.999s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:32:57 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:32:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:32:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:32:59 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 07 22:32:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823" returned: 0 in 6.334s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:32:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aed304-099a-4006-865f-ecf7013143e8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:32:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:32:59 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 Jul 07 22:32:59 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:00 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29" returned: 0 in 1.086s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:00 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:33:00 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Converted 1024.00 MB image at 161.61 MB/s Jul 07 22:33:00 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:33:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:00 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 Jul 07 22:33:00 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:01 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823" returned: 0 in 0.953s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Lock "cinder-quobyte-1249dbfb-350e-44ba-8216-f1752685f823" released by "_copy_volume_from_snapshot" :: held 10.520s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Acquiring lock "cinder-quobyte-e8cfa3ee-8a27-4a9a-9119-37e9bd385706" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Lock "cinder-quobyte-e8cfa3ee-8a27-4a9a-9119-37e9bd385706" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Deleting offline snapshot e8cfa3ee-8a27-4a9a-9119-37e9bd385706 of volume 48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:33:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] snapshot_file for this snap is: volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:33:01 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f646b-dda1-483c-a3c2-dc52a12fce1c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:02 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 Jul 07 22:33:02 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:02 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706" returned: 0 in 0.989s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48cca724-19ce-4db4-aff5-ad3663edca29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:33:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc6b84-e216-4c48-8321-eb7d05a9aa33]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:03 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 Jul 07 22:33:03 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:03 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=43,cinder:INSERT=14,cinder:UPDATE=49,cinder:DELETE=5 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:33:04 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29" returned: 0 in 1.054s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:04 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 Jul 07 22:33:04 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:04 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706" returned: 0 in 0.917s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:04 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706 Jul 07 22:33:04 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:05 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29.e8cfa3ee-8a27-4a9a-9119-37e9bd385706" returned: 0 in 0.856s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Lock "cinder-quobyte-e8cfa3ee-8a27-4a9a-9119-37e9bd385706" released by "_delete_snapshot" :: held 3.971s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.304s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.743s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-481010901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8345667-831c-49f2-b1d9-43267d908de3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='190f1a5dabd84ebb8157e04e8950c924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:45Z,use_quota=True,user_id='25396473ac734f6783d5773c62184d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Creating volume f8345667-831c-49f2-b1d9-43267d908de3 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:33:05 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:33:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:05 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 1073741824 Jul 07 22:33:05 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:06 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-abd36b33-624a-4df6-aecf-84e1ffa484de tempest-GroupsV314Test-1987471961 None] Create group from source-group-dce8f7d7-573c-4443-8ff0-6db609c17805 completed successfully. Jul 07 22:33:07 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 1073741824" returned: 0 in 1.214s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:07 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 Jul 07 22:33:07 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Acquiring lock "cinder-quobyte-1249dbfb-350e-44ba-8216-f1752685f823" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Lock "cinder-quobyte-1249dbfb-350e-44ba-8216-f1752685f823" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bbb909-63e9-4511-8a12-9953493f5ae9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:07 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 Jul 07 22:33:07 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:08 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3" returned: 0 in 0.872s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.103s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1295292161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98568f7-9b07-44b9-a272-0cda9224d80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030a06154a94464aa0d29b5f13b57a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:54Z,use_quota=True,user_id='6385bf54954a458d9b27e355d5fe2c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Creating volume a98568f7-9b07-44b9-a272-0cda9224d80d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:33:08 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a2e50-6fec-4884-b980-37bdb2338786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8345667-831c-49f2-b1d9-43267d908de3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bdf9bd-426d-439d-a544-bb022f1f18f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:08 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d 1073741824 Jul 07 22:33:08 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:08 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Volume volume-f8345667-831c-49f2-b1d9-43267d908de3 (f8345667-831c-49f2-b1d9-43267d908de3): created successfully Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bdf9bd-426d-439d-a544-bb022f1f18f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Flow 'volume_create_manager' (40d2ef29-d377-4b04-9e58-beaaae8e247c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-25ca0aea-81e3-4e5a-b580-18c30bd58d18 tempest-VolumesTestJSON-2107174243 None] Created volume successfully. Jul 07 22:33:08 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823" returned: 0 in 1.093s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:08 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823 Jul 07 22:33:08 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:09 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d 1073741824" returned: 0 in 1.069s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:09 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d Jul 07 22:33:09 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:09 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1249dbfb-350e-44ba-8216-f1752685f823" returned: 0 in 0.984s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Lock "cinder-quobyte-1249dbfb-350e-44ba-8216-f1752685f823" released by "delete_volume" :: held 2.146s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Created reservations ['973f0818-ff8a-4768-a5b2-aeea540d285f'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:09 devstack cinder-volume[87612]: WARNING cinder.quota [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-240460724 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-240460724, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:33:09 devstack cinder-volume[87612]: WARNING cinder.quota [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-240460724 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-240460724, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Created reservations ['92041ef0-3fe4-4118-b158-c419a846a79a', '77f44962-815c-4888-a290-839ef2642b17', '93da7a9e-22f1-410e-94b1-b800078ec957', 'e3be7275-16e4-4383-8266-64109c8c0589'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:09 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:33:09 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Acquiring lock "cinder-f8345667-831c-49f2-b1d9-43267d908de3-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Lock "cinder-f8345667-831c-49f2-b1d9-43267d908de3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Acquiring lock "cinder-quobyte-f8345667-831c-49f2-b1d9-43267d908de3" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Lock "cinder-quobyte-f8345667-831c-49f2-b1d9-43267d908de3" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:10 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d" returned: 0 in 1.187s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[014442ee-163b-407e-8c28-bdf6274b7d1e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f834840-b3d0-4856-a5a4-0254b7e7939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98568f7-9b07-44b9-a272-0cda9224d80d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5302f198-5f95-47f3-8b46-bb900eabe5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:10 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Volume volume-a98568f7-9b07-44b9-a272-0cda9224d80d (a98568f7-9b07-44b9-a272-0cda9224d80d): created successfully Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5302f198-5f95-47f3-8b46-bb900eabe5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Flow 'volume_create_manager' (45237e3a-e60a-41b1-8684-c430e3211d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:10 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7db43cc7-b1fc-46ee-9bc8-72c0bf3ec4ea tempest-SnapshotMetadataTestJSON-1338137318 None] Created volume successfully. Jul 07 22:33:10 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 Jul 07 22:33:10 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:10 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.869s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:10 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:10 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d345d7f3-a387-4532-a4bc-1f8a8bda3eb9 tempest-GroupsV314Test-1987471961 None] Delete group completed successfully. Jul 07 22:33:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Acquiring lock "cinder-quobyte-48cca724-19ce-4db4-aff5-ad3663edca29" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Lock "cinder-quobyte-48cca724-19ce-4db4-aff5-ad3663edca29" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:11 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ad8efd-14d6-475e-ba21-d5ad9d631906]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:11 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3" returned: 0 in 0.971s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:11 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3 Jul 07 22:33:11 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:11 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 Jul 07 22:33:11 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Creating offline snapshot 9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 of volume a98568f7-9b07-44b9-a272-0cda9224d80d {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c2f73c-eacc-461f-bb92-5dfa1e9bdffe]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:12 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8345667-831c-49f2-b1d9-43267d908de3" returned: 0 in 0.868s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Lock "cinder-quobyte-f8345667-831c-49f2-b1d9-43267d908de3" released by "delete_volume" :: held 1.924s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:12 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d Jul 07 22:33:12 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Created reservations ['812feb2d-5abf-40ec-9469-711ca45677bf', '28fef8e3-4c3a-40f4-8967-39884ee36c15', '3812d4bd-fb2c-40bd-9a58-b58c8178c7d3', '3bbe62e1-4222-495a-8f33-dde6c327267d'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:12 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29" returned: 0 in 1.179s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:12 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29 Jul 07 22:33:12 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:12 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:33:12 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Acquiring lock "cinder-52277195-e2b1-47af-8d6d-2d98ad34e135-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Lock "cinder-52277195-e2b1-47af-8d6d-2d98ad34e135-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Acquiring lock "cinder-quobyte-52277195-e2b1-47af-8d6d-2d98ad34e135" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Lock "cinder-quobyte-52277195-e2b1-47af-8d6d-2d98ad34e135" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e56798-9cc7-48fd-87bd-bb860fc1c360]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:13 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 Jul 07 22:33:13 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:13 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d" returned: 0 in 1.360s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:13 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.920s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Deleted volume successfully. Jul 07 22:33:13 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 1G Jul 07 22:33:13 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5767ad15-6bde-4111-b779-51ae83a991fb tempest-VolumesTestJSON-2107174243 None] Lock "cinder-f8345667-831c-49f2-b1d9-43267d908de3-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:13 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-48cca724-19ce-4db4-aff5-ad3663edca29" returned: 0 in 1.257s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Lock "cinder-quobyte-48cca724-19ce-4db4-aff5-ad3663edca29" released by "delete_volume" :: held 2.532s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Created reservations ['f4121a09-8f53-4d18-b625-b84664fdc3ff'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:13 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Created reservations ['72ee8227-c270-45e1-9523-4893e6a3da17', 'de04668a-d920-4762-8ca6-8b983387d710', '12606cc3-1f5b-4ca0-8012-257a41d419b5', 'd7399f20-5432-4163-8c7a-41f51350c797'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:14 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:33:14 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:14 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135" returned: 0 in 1.291s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:14 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135 Jul 07 22:33:14 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:14 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 1G" returned: 0 in 1.270s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98568f7-9b07-44b9-a272-0cda9224d80d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:14 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98568f7-9b07-44b9-a272-0cda9224d80d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 Jul 07 22:33:14 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:15 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-52277195-e2b1-47af-8d6d-2d98ad34e135" returned: 0 in 0.816s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Lock "cinder-quobyte-52277195-e2b1-47af-8d6d-2d98ad34e135" released by "delete_volume" :: held 2.204s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:15 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.996s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-67223f39-939a-424f-8f83-12dd74c4c705 tempest-GroupsV314Test-1987471961 None] Delete group completed successfully. Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Created reservations ['706cd3b7-9eb8-4fb1-99c5-29c998572e76', '31f58910-5bde-45e2-8f94-ccab122c6a02', 'f70d2070-c578-40ed-8c7a-ee23ebdb11e4', '57982d6f-4589-471a-b3b3-80c83080702e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:15 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:33:15 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:15 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98568f7-9b07-44b9-a272-0cda9224d80d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10" returned: 0 in 1.078s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:15 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 is being set with open permissions: ugo+rw Jul 07 22:33:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:15 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 Jul 07 22:33:15 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:16 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.783s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:16 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Deleted volume successfully. Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cef94b3-8fba-4f9c-846e-2350fbb4885f tempest-VolumesTestJSON-2107174243 None] Lock "cinder-52277195-e2b1-47af-8d6d-2d98ad34e135-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Acquiring lock "cinder-9182f8dc-78a5-4a17-a060-3d46324050fa-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Lock "cinder-9182f8dc-78a5-4a17-a060-3d46324050fa-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Acquiring lock "cinder-quobyte-9182f8dc-78a5-4a17-a060-3d46324050fa" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Lock "cinder-quobyte-9182f8dc-78a5-4a17-a060-3d46324050fa" acquired by "delete_volume" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3498790-f2d4-4913-8e11-f341652ea9f3]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:16 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa Jul 07 22:33:16 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:16 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10" returned: 0 in 0.998s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:16 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.info Jul 07 22:33:16 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:17 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa" returned: 0 in 1.204s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:17 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa Jul 07 22:33:17 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:17 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.info" returned: 0 in 0.943s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:17 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.info is being set with open permissions: ugo+rw Jul 07 22:33:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:17 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.info Jul 07 22:33:17 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:18 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9182f8dc-78a5-4a17-a060-3d46324050fa" returned: 0 in 0.972s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Lock "cinder-quobyte-9182f8dc-78a5-4a17-a060-3d46324050fa" released by "delete_volume" :: held 2.261s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Created reservations ['147e0420-5799-4d78-89e9-9523bbd3eef6', 'a45a023a-a222-4aa5-a36e-83495de4390d', 'ee6e3226-8e57-4ada-b491-9b8c12afa074', '2e7c0a04-294e-418e-b490-51036f254388'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:18 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:33:18 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:18 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.info" returned: 0 in 1.122s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.941s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1d540892-2886-4867-9e6d-096aa5b3b4b2 tempest-SnapshotMetadataTestJSON-1338137318 None] Create snapshot completed successfully Jul 07 22:33:19 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.976s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:19 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Deleted volume successfully. Jul 07 22:33:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3cb90011-bdbb-4233-8512-ff3de737125c tempest-VolumesTestJSON-2107174243 None] Lock "cinder-9182f8dc-78a5-4a17-a060-3d46324050fa-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "cinder-9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "cinder-quobyte-a98568f7-9b07-44b9-a272-0cda9224d80d" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-quobyte-a98568f7-9b07-44b9-a272-0cda9224d80d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "cinder-quobyte-9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-quobyte-9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Deleting offline snapshot 9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 of volume a98568f7-9b07-44b9-a272-0cda9224d80d {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:33:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] snapshot_file for this snap is: volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:33:21 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9a0c18-a924-41db-8e5d-399bfb3faada]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:21 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 Jul 07 22:33:21 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:22 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10" returned: 0 in 1.241s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a98568f7-9b07-44b9-a272-0cda9224d80d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:33:22 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[84526955-ba4b-4072-bc69-f29a51e1343b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:22 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d Jul 07 22:33:22 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:23 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d" returned: 0 in 1.109s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:23 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 Jul 07 22:33:23 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Flow 'volume_create_manager' (fd00ef97-a406-4cca-8a21-9cf710ca8de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a05357b-39ae-410b-9b4b-dfb763175cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a05357b-39ae-410b-9b4b-dfb763175cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1336216178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32272408-505c-44d4-ac21-ed94b4a9422e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679c44117ac4464aa07244d5606a47db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:24Z,use_quota=True,user_id='09d3fece94fe4dca92d7a56b00b4b8e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d02fa6-757a-4e79-993d-b8e1ff89f080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d02fa6-757a-4e79-993d-b8e1ff89f080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef49c72-49d2-40e1-ab24-eb5d8570bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef49c72-49d2-40e1-ab24-eb5d8570bc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32272408-505c-44d4-ac21-ed94b4a9422e', 'volume_name': 'volume-32272408-505c-44d4-ac21-ed94b4a9422e', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912c5f2a-e1bf-4ccf-a797-cc0ee0cef3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912c5f2a-e1bf-4ccf-a797-cc0ee0cef3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bfaf96-e84b-47d5-8b72-a5904f4b1367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:24 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Volume 32272408-505c-44d4-ac21-ed94b4a9422e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32272408-505c-44d4-ac21-ed94b4a9422e', 'volume_size': 1} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1336216178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32272408-505c-44d4-ac21-ed94b4a9422e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679c44117ac4464aa07244d5606a47db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:24Z,use_quota=True,user_id='09d3fece94fe4dca92d7a56b00b4b8e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Creating volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:33:24 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:24 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e 1073741824 Jul 07 22:33:24 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:24 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10" returned: 0 in 1.310s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:24 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10 Jul 07 22:33:24 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:26 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d.9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10" returned: 0 in 1.370s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-quobyte-9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10" released by "_delete_snapshot" :: held 5.258s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-quobyte-a98568f7-9b07-44b9-a272-0cda9224d80d" released by "delete_snapshot" :: held 5.311s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:26 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e 1073741824" returned: 0 in 1.866s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:26 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e Jul 07 22:33:26 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:26 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Created reservations ['57e61254-120e-46ae-9de0-7daf525445f4', '488278cf-c36a-4882-a579-0cfaea02702d', 'ab4fc18f-3998-4a69-aa6d-b2f079be5352', 'f87ace80-10c5-4e4e-b3e7-2a6ceaafa316'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Delete snapshot completed successfully. Jul 07 22:33:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b9e591ad-7021-4efb-8542-5bbcb03308b6 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-9a83c661-cea0-4ad6-8ed9-a3a0ef59fa10-delete_snapshot" released by "delete_snapshot" :: held 5.638s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:27 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e" returned: 0 in 0.883s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] <== create_volume: return (2816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bfaf96-e84b-47d5-8b72-a5904f4b1367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32272408-505c-44d4-ac21-ed94b4a9422e', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27f5d7b-fac0-4823-af20-408a0e70471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:27 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Volume volume-32272408-505c-44d4-ac21-ed94b4a9422e (32272408-505c-44d4-ac21-ed94b4a9422e): created successfully Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27f5d7b-fac0-4823-af20-408a0e70471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Flow 'volume_create_manager' (fd00ef97-a406-4cca-8a21-9cf710ca8de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:27 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-40a53cab-b2eb-466a-9c39-c322703c6b17 tempest-SnapshotsActionsTest-1050584359 None] Created volume successfully. Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Flow 'volume_create_manager' (b006d213-907b-4b7b-b99b-37d19119222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7958583-79e4-4e9a-b2fc-cbcd88681a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7958583-79e4-4e9a-b2fc-cbcd88681a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1369051253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf01f6f-2043-48bc-9493-1b563b2465b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b7349156f14f7a87c68eaba24f6a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:27Z,use_quota=True,user_id='9edda47d7c5f4127bec73a7123e43dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c3e71d-ec66-4e39-8b38-5e10e418587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c3e71d-ec66-4e39-8b38-5e10e418587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd3b2db-c60c-425c-9eb1-ccedba1695c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd3b2db-c60c-425c-9eb1-ccedba1695c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf01f6f-2043-48bc-9493-1b563b2465b6', 'volume_name': 'volume-9cf01f6f-2043-48bc-9493-1b563b2465b6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb825a5-9177-4fd1-813e-e65d613fcc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb825a5-9177-4fd1-813e-e65d613fcc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686dfdd9-981a-43e8-bfe9-972f8806d815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:27 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Volume 9cf01f6f-2043-48bc-9493-1b563b2465b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf01f6f-2043-48bc-9493-1b563b2465b6', 'volume_size': 1} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1369051253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf01f6f-2043-48bc-9493-1b563b2465b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b7349156f14f7a87c68eaba24f6a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:27Z,use_quota=True,user_id='9edda47d7c5f4127bec73a7123e43dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Creating volume 9cf01f6f-2043-48bc-9493-1b563b2465b6 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:33:27 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "cinder-a98568f7-9b07-44b9-a272-0cda9224d80d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:27 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 1073741824 Jul 07 22:33:27 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-a98568f7-9b07-44b9-a272-0cda9224d80d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "cinder-quobyte-a98568f7-9b07-44b9-a272-0cda9224d80d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-quobyte-a98568f7-9b07-44b9-a272-0cda9224d80d" acquired by "delete_volume" :: waited 0.042s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c440ff11-584a-446c-a0c1-61bb710d9c11]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:28 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d Jul 07 22:33:28 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Flow 'volume_create_manager' (9ac42a9e-8c5e-4536-8067-39f1f55269d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed104569-9e91-4d33-994c-3eb63945ac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed104569-9e91-4d33-994c-3eb63945ac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-515924314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42a14b4-bc01-45d1-b0fa-9310ad83d297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b7349156f14f7a87c68eaba24f6a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:28Z,use_quota=True,user_id='9edda47d7c5f4127bec73a7123e43dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdeb36b-aaf4-4c38-9d0a-61e46369c266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdeb36b-aaf4-4c38-9d0a-61e46369c266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184d72b7-aad6-4037-8c42-5b795af84851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184d72b7-aad6-4037-8c42-5b795af84851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42a14b4-bc01-45d1-b0fa-9310ad83d297', 'volume_name': 'volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab60b0f-1425-482b-ba15-da46bef6e5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab60b0f-1425-482b-ba15-da46bef6e5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c799b3b6-5c49-44b3-bf7b-47c345310885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Volume c42a14b4-bc01-45d1-b0fa-9310ad83d297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297', 'volume_size': 1} Jul 07 22:33:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:29 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 1073741824" returned: 0 in 1.553s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:29 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 Jul 07 22:33:29 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:29 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d" returned: 0 in 1.395s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:29 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d Jul 07 22:33:29 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:30 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6" returned: 0 in 0.946s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] <== create_volume: return (2566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.570s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-515924314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42a14b4-bc01-45d1-b0fa-9310ad83d297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b7349156f14f7a87c68eaba24f6a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:28Z,use_quota=True,user_id='9edda47d7c5f4127bec73a7123e43dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Creating volume c42a14b4-bc01-45d1-b0fa-9310ad83d297 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:33:30 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686dfdd9-981a-43e8-bfe9-972f8806d815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf01f6f-2043-48bc-9493-1b563b2465b6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b9b8fa-8d68-4fe6-a44a-60cedd28419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:30 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 1073741824 Jul 07 22:33:30 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Volume volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 (9cf01f6f-2043-48bc-9493-1b563b2465b6): created successfully Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b9b8fa-8d68-4fe6-a44a-60cedd28419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Flow 'volume_create_manager' (b006d213-907b-4b7b-b99b-37d19119222d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cb6ed7c9-634b-48b2-a06c-e435b7ccbb9d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Created volume successfully. Jul 07 22:33:30 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98568f7-9b07-44b9-a272-0cda9224d80d" returned: 0 in 1.129s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-quobyte-a98568f7-9b07-44b9-a272-0cda9224d80d" released by "delete_volume" :: held 2.642s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Created reservations ['f48e00d4-4d43-450d-b7c7-4693eedaaa76', '0785d0b3-ca58-4672-9f7b-51d1eb214cd3', '6e93c862-3605-40e6-a41b-d23ca8c47640', '1950c676-fed4-41ac-905e-0fa5d23c9761'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:30 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:33:30 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:31 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 1073741824" returned: 0 in 1.406s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:31 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.995s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:31 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:31 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Deleted volume successfully. Jul 07 22:33:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:31 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 Jul 07 22:33:31 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4f4735bb-c930-4b59-a12c-e566baf06fb7 tempest-SnapshotMetadataTestJSON-1338137318 None] Lock "cinder-a98568f7-9b07-44b9-a272-0cda9224d80d-delete_volume" released by "delete_volume" :: held 4.022s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:32 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297" returned: 0 in 1.154s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] <== create_volume: return (2651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.654s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.745s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Creating offline snapshot 07c8975b-5131-4a31-ad8d-f5f8309870ae of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c799b3b6-5c49-44b3-bf7b-47c345310885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26073a3-9e46-4034-9eb5-0740f317def0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa52a8ed-9f4e-499d-93ec-de93e42c83fa]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:32 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Volume volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 (c42a14b4-bc01-45d1-b0fa-9310ad83d297): created successfully Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26073a3-9e46-4034-9eb5-0740f317def0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Flow 'volume_create_manager' (9ac42a9e-8c5e-4536-8067-39f1f55269d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:32 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3aa5e325-84e5-46a0-bac5-4a35402bc725 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Created volume successfully. Jul 07 22:33:33 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e Jul 07 22:33:33 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:34 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e" returned: 0 in 1.164s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:34 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae 1G Jul 07 22:33:34 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:35 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae 1G" returned: 0 in 1.366s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:35 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:33:35 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:36 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 0.973s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:36 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae is being set with open permissions: ugo+rw Jul 07 22:33:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:36 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:33:36 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:37 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 0.957s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:37 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=134,cinder:SELECT=104,cinder:INSERT=41,cinder:DELETE=8 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:33:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:37 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.info Jul 07 22:33:37 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:38 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.info" returned: 0 in 0.836s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:38 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.info is being set with open permissions: ugo+rw Jul 07 22:33:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:38 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.info Jul 07 22:33:38 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:39 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.info" returned: 0 in 0.841s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.297s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-112ec3e9-d5bb-4744-8907-852844b8521e tempest-SnapshotsActionsTest-1050584359 None] Create snapshot completed successfully Jul 07 22:33:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Creating offline snapshot ac41e671-909e-44c5-894a-19a1bbb50efa of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:33:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b03e0db-06df-4565-979c-f5574c9aa66f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:41 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:33:41 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:42 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.370s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:42 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa 1G Jul 07 22:33:42 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Flow 'volume_create_manager' (fd55630d-ed84-4928-a2aa-7b878eaf9b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325f4f75-ee57-438a-a563-b7308517ec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325f4f75-ee57-438a-a563-b7308517ec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1896561583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab8ec51-7e83-4c97-a5b9-28ad8a1ed437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab34d90ef44a9685d37984a0f5dc68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:43Z,use_quota=True,user_id='c8068c3a4f914dba9595654528560dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73089c13-777d-412f-a416-d1b2fe797fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73089c13-777d-412f-a416-d1b2fe797fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6787f8-e50a-4f13-a0a6-55d8d6686a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6787f8-e50a-4f13-a0a6-55d8d6686a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab8ec51-7e83-4c97-a5b9-28ad8a1ed437', 'volume_name': 'volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cecc905-4c8b-4cc8-b6ab-70743589478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cecc905-4c8b-4cc8-b6ab-70743589478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dd5dc7-3a08-4b4a-a0e9-20eb6aff9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:42 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Volume bab8ec51-7e83-4c97-a5b9-28ad8a1ed437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437', 'volume_size': 1} Jul 07 22:33:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:43 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa 1G" returned: 0 in 1.201s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:43 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa Jul 07 22:33:43 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:44 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa" returned: 0 in 0.984s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:44 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa is being set with open permissions: ugo+rw Jul 07 22:33:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:44 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa Jul 07 22:33:44 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:45 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa" returned: 0 in 0.818s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.813s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1896561583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab8ec51-7e83-4c97-a5b9-28ad8a1ed437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab34d90ef44a9685d37984a0f5dc68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:43Z,use_quota=True,user_id='c8068c3a4f914dba9595654528560dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Creating volume bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:33:45 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:33:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:45 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 1073741824 Jul 07 22:33:45 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9e454bfc-ae61-46bb-b798-d8470cbf5b85 tempest-SnapshotsActionsTest-1050584359 None] Create snapshot completed successfully Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-ac41e671-909e-44c5-894a-19a1bbb50efa-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-ac41e671-909e-44c5-894a-19a1bbb50efa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-quobyte-ac41e671-909e-44c5-894a-19a1bbb50efa" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-ac41e671-909e-44c5-894a-19a1bbb50efa" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Deleting offline snapshot ac41e671-909e-44c5-894a-19a1bbb50efa of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] snapshot_file for this snap is: volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c198cdd-3a21-4891-8452-adaa455230d1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:46 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa Jul 07 22:33:46 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:46 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 1073741824" returned: 0 in 1.122s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:46 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 Jul 07 22:33:46 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:48 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437" returned: 0 in 1.306s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] <== create_volume: return (2584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:48 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dd5dc7-3a08-4b4a-a0e9-20eb6aff9c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457b6a30-18ed-4c4b-95d8-a4fd75c39b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa" returned: 0 in 1.695s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:33:48 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Volume volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 (bab8ec51-7e83-4c97-a5b9-28ad8a1ed437): created successfully Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457b6a30-18ed-4c4b-95d8-a4fd75c39b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Flow 'volume_create_manager' (fd55630d-ed84-4928-a2aa-7b878eaf9b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e355b2-566c-4d5a-9f1c-6f394e337b11]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7c837c77-b6a9-44de-9b89-a0b0fd59bf2a tempest-AbsoluteLimitsTests-507406667 None] Created volume successfully. Jul 07 22:33:48 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:33:48 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Acquiring lock "cinder-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Lock "cinder-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:49 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.184s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Acquiring lock "cinder-quobyte-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Lock "cinder-quobyte-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437" acquired by "delete_volume" :: waited 0.047s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:33:49 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa Jul 07 22:33:49 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80c6a09-cf3f-46a4-81ea-4e9dd1b531a1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:49 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 Jul 07 22:33:49 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:50 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa" returned: 0 in 1.408s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:50 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa Jul 07 22:33:50 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:50 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437" returned: 0 in 1.440s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:51 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437 Jul 07 22:33:51 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:51 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.ac41e671-909e-44c5-894a-19a1bbb50efa" returned: 0 in 1.007s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-ac41e671-909e-44c5-894a-19a1bbb50efa" released by "_delete_snapshot" :: held 5.466s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" released by "delete_snapshot" :: held 5.509s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Created reservations ['9eb8c42e-9dd5-411f-b046-eddfb043beeb', 'fa53f0a0-d0ee-43c5-8191-a52c4c2b0ceb', 'eeea66c4-811d-4d1d-89cd-33dd5e25b346', '0cac9d1c-8476-4682-8f76-b2407b427b1e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:52 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437" returned: 0 in 1.194s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Lock "cinder-quobyte-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437" released by "delete_volume" :: held 2.728s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:52 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Delete snapshot completed successfully. Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b862cad4-5097-4496-8cc4-ea87790e179e tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-ac41e671-909e-44c5-894a-19a1bbb50efa-delete_snapshot" released by "delete_snapshot" :: held 5.870s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Created reservations ['b9943510-de66-4df9-817e-8a8d4843bc9f', '75b4ea24-2680-4e6a-847e-2b7e2b861507', '6f4c7a12-5501-4fe4-a5f3-574a76863c96', 'edec098a-0c29-4c58-a466-ca4d1625b9aa'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:52 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:33:52 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:53 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.211s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:53 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Deleted volume successfully. Jul 07 22:33:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-94c40b75-7029-43a3-bf68-0e9d2b7d6317 tempest-AbsoluteLimitsTests-507406667 None] Lock "cinder-bab8ec51-7e83-4c97-a5b9-28ad8a1ed437-delete_volume" released by "delete_volume" :: held 4.450s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:33:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Creating offline snapshot 903a48e3-4893-40ce-9eec-78a7f1b9fd8d of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:33:53 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[574aac54-29a4-4ae5-aa15-19da4973a4a2]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:33:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:54 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:33:54 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:55 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.736s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:33:55 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d 1G Jul 07 22:33:55 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:55 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:33:55 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:57 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.279s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:33:57 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:33:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:33:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:33:57 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d 1G" returned: 0 in 1.675s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:57 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d Jul 07 22:33:57 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:58 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d" returned: 0 in 1.247s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:58 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d is being set with open permissions: ugo+rw Jul 07 22:33:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:33:58 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d Jul 07 22:33:58 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:33:59 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 07 22:33:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d" returned: 0 in 0.977s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:33:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.790s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:33:59 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4f17aeea-85f3-46bc-ad74-52866f82f6e3 tempest-SnapshotsActionsTest-1050584359 None] Create snapshot completed successfully Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-903a48e3-4893-40ce-9eec-78a7f1b9fd8d-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-903a48e3-4893-40ce-9eec-78a7f1b9fd8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-quobyte-903a48e3-4893-40ce-9eec-78a7f1b9fd8d" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-903a48e3-4893-40ce-9eec-78a7f1b9fd8d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Deleting offline snapshot 903a48e3-4893-40ce-9eec-78a7f1b9fd8d of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] snapshot_file for this snap is: volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de893fc-f627-4387-9b45-62339717ca39]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:34:00 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d Jul 07 22:34:00 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (9b776fff-b619-48bd-9a92-5f9d34624fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97f53f8-a092-4cc5-b9d3-8aa2ee89c62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97f53f8-a092-4cc5-b9d3-8aa2ee89c62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1408906777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:01Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee96454-8251-4290-8726-81f7de253860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee96454-8251-4290-8726-81f7de253860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c402a084-2928-4dd4-9713-d3e6c872e7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c402a084-2928-4dd4-9713-d3e6c872e7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd152b93c-fae3-4ad7-b6ab-2508d0c1aaa5', 'volume_name': 'volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cc1939-0eab-478d-b211-b193fc2b139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cc1939-0eab-478d-b211-b193fc2b139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80c0cdb-d7bc-498c-89f7-a026678bb30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:00 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Volume d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5', 'volume_size': 1} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1408906777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:01Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Creating volume d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:34:00 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:34:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:00 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 1073741824 Jul 07 22:34:00 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:01 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d" returned: 0 in 1.183s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:01 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac292f9-0eb2-4e0d-b48d-341c92b12642]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:01 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:34:01 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:02 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 1073741824" returned: 0 in 1.180s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:02 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 Jul 07 22:34:02 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:03 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.243s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:03 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d Jul 07 22:34:03 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:03 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5" returned: 0 in 1.007s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80c0cdb-d7bc-498c-89f7-a026678bb30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc131c5e-11ec-427d-a842-740f9c8384c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:03 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Volume volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 (d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5): created successfully Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc131c5e-11ec-427d-a842-740f9c8384c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (9b776fff-b619-48bd-9a92-5f9d34624fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:03 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b64caaaf-ad22-4496-ab3f-7c5a3b9da663 tempest-VolumesGetTest-1033219681 None] Created volume successfully. Jul 07 22:34:04 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d" returned: 0 in 1.201s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:04 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d Jul 07 22:34:04 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=100,cinder:SELECT=77,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (69883229-7e36-4cf2-8ad8-a2ab7fee834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55e4fc5-68ac-4214-a3d7-1c6813834add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55e4fc5-68ac-4214-a3d7-1c6813834add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-114076483',display_name='tempest-VolumesGetTest-Volume-1964073849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7980e772-a0c9-41d8-bdc0-c2eb94051b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:05Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9375705d-9c53-4d84-bcf4-a5a66d86c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9375705d-9c53-4d84-bcf4-a5a66d86c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcb14af-394a-4db7-bd7f-663bc57c9094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcb14af-394a-4db7-bd7f-663bc57c9094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7980e772-a0c9-41d8-bdc0-c2eb94051b09', 'volume_name': 'volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1884a7-c7d7-40b7-902d-01787ff61e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1884a7-c7d7-40b7-902d-01787ff61e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ba61d0-5888-4055-ae65-e588b6ce11c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:05 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Volume 7980e772-a0c9-41d8-bdc0-c2eb94051b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09', 'volume_size': 1} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-114076483',display_name='tempest-VolumesGetTest-Volume-1964073849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7980e772-a0c9-41d8-bdc0-c2eb94051b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:05Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Creating volume 7980e772-a0c9-41d8-bdc0-c2eb94051b09 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:34:05 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:05 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 1073741824 Jul 07 22:34:05 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:05 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.903a48e3-4893-40ce-9eec-78a7f1b9fd8d" returned: 0 in 1.182s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-903a48e3-4893-40ce-9eec-78a7f1b9fd8d" released by "_delete_snapshot" :: held 4.974s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" released by "delete_snapshot" :: held 5.013s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Created reservations ['6c370442-4a81-46e5-8d38-0944f0a7c85a', 'b25b7f88-00a3-46ff-9288-dae573a9c881', '56d1e0cc-85fc-4733-9785-8eea2716ab07', 'dfbde8a5-4929-4ac0-83a8-257b1eb646a0'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Delete snapshot completed successfully. Jul 07 22:34:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-40d56524-5761-4a7f-9506-30d3b3e9b612 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-903a48e3-4893-40ce-9eec-78a7f1b9fd8d-delete_snapshot" released by "delete_snapshot" :: held 5.249s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:06 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 1073741824" returned: 0 in 1.199s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:06 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 Jul 07 22:34:06 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:07 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09" returned: 0 in 0.837s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.989s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Creating offline snapshot c1ef979a-44c0-46af-b0a8-79f2a13da87e of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ba61d0-5888-4055-ae65-e588b6ce11c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263062bd-8d0e-45ea-a4ec-03ab23b94cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae952f-5870-4d44-9ac9-b80f75687b76]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Volume volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 (7980e772-a0c9-41d8-bdc0-c2eb94051b09): created successfully Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263062bd-8d0e-45ea-a4ec-03ab23b94cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (69883229-7e36-4cf2-8ad8-a2ab7fee834e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5c47b22b-2284-49ec-9624-8bac3df3335b tempest-VolumesGetTest-1033219681 None] Created volume successfully. Jul 07 22:34:07 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:34:07 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-7980e772-a0c9-41d8-bdc0-c2eb94051b09-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Lock "cinder-7980e772-a0c9-41d8-bdc0-c2eb94051b09-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-7980e772-a0c9-41d8-bdc0-c2eb94051b09" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-7980e772-a0c9-41d8-bdc0-c2eb94051b09" acquired by "delete_volume" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:08 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.136s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[308a488f-4cdb-4758-bfab-2395cf49f797]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:08 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e 1G Jul 07 22:34:08 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:08 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 Jul 07 22:34:08 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:09 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09" returned: 0 in 1.120s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:09 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09 Jul 07 22:34:09 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:09 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e 1G" returned: 0 in 1.295s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:09 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e Jul 07 22:34:09 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:10 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7980e772-a0c9-41d8-bdc0-c2eb94051b09" returned: 0 in 0.909s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-7980e772-a0c9-41d8-bdc0-c2eb94051b09" released by "delete_volume" :: held 2.132s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Created reservations ['00cfdc91-e649-4786-9b35-fbc55375176a', '2ed36732-c6c8-4053-8e51-5d0cb077e3d9', '1806d4be-b3de-451e-a819-8e9fa4c7f771', 'e44ea69d-26bf-4ec6-abdb-c48bd160d5bc'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:10 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:34:10 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:11 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e" returned: 0 in 1.190s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:11 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e is being set with open permissions: ugo+rw Jul 07 22:34:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:11 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e Jul 07 22:34:11 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:11 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.866s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:11 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:34:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Deleted volume successfully. Jul 07 22:34:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b625bbe0-9567-4ee4-9e90-63425b26b49b tempest-VolumesGetTest-1033219681 None] Lock "cinder-7980e772-a0c9-41d8-bdc0-c2eb94051b09-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:11 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e" returned: 0 in 0.930s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.717s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Lock "cinder-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5c17c89f-3ca3-44bb-b8f3-6fb97b230bd1 tempest-SnapshotsActionsTest-1050584359 None] Create snapshot completed successfully Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff4f569-e8a8-40a6-b813-3d0ff5695ea7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:12 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 Jul 07 22:34:12 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-c1ef979a-44c0-46af-b0a8-79f2a13da87e-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-c1ef979a-44c0-46af-b0a8-79f2a13da87e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-quobyte-c1ef979a-44c0-46af-b0a8-79f2a13da87e" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-c1ef979a-44c0-46af-b0a8-79f2a13da87e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Deleting offline snapshot c1ef979a-44c0-46af-b0a8-79f2a13da87e of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] snapshot_file for this snap is: volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf68930-ef23-48ba-a737-61a6ef533087]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:13 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e Jul 07 22:34:13 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:13 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5" returned: 0 in 0.996s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:13 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5 Jul 07 22:34:13 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:13 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e" returned: 0 in 0.952s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:13 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5" returned: 0 in 0.785s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:13 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d3c632-1657-4943-bba4-fe605988f67a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5" released by "delete_volume" :: held 1.868s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:14 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Created reservations ['3df14961-6234-4e66-8c87-0a9f1dfc51f4', 'ceaaa790-cd1b-44a9-8ca4-2596802cde29', '87c60006-71ae-4fe7-903a-ddfb05a80d43', '65e63b6d-269f-4781-825b-7c927bf61e94'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:14 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:34:14 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:14 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:34:14 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (517780e6-bba2-4ba0-ad4f-85a391ab6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f90255e-79eb-47f6-a6ec-05369ab63734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f90255e-79eb-47f6-a6ec-05369ab63734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2022658166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:15Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e916d0eb-4527-4c50-aed5-4b71c7d17fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e916d0eb-4527-4c50-aed5-4b71c7d17fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dae2ca-cf79-4584-b6b2-036f6c36c42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dae2ca-cf79-4584-b6b2-036f6c36c42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2', 'volume_name': 'volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248cdce7-2333-414d-8772-14c94fa5856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248cdce7-2333-414d-8772-14c94fa5856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:15 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e25d70-d676-4319-aa3c-fd116d6ac9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Volume bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2', 'volume_size': 1} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2022658166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:15Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Creating volume bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:34:15 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.369s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:15 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 1073741824 Jul 07 22:34:15 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:15 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e Jul 07 22:34:15 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:15 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.238s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:34:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Deleted volume successfully. Jul 07 22:34:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e568cd5-f605-422f-8e0a-db7ae3eb3e5e tempest-VolumesGetTest-1033219681 None] Lock "cinder-d152b93c-fae3-4ad7-b6ab-2508d0c1aaa5-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:16 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e" returned: 0 in 1.023s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:16 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e Jul 07 22:34:16 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:16 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 1073741824" returned: 0 in 1.217s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:16 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 Jul 07 22:34:16 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:17 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.c1ef979a-44c0-46af-b0a8-79f2a13da87e" returned: 0 in 0.940s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-c1ef979a-44c0-46af-b0a8-79f2a13da87e" released by "_delete_snapshot" :: held 4.438s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" released by "delete_snapshot" :: held 4.480s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Created reservations ['a0e635a6-c693-46cb-80a1-3eca22727947', 'a14e6bed-6c02-4a0a-b9ec-8710c5efb0a7', '1ab085c4-02d7-4e77-85c6-04dfef7b4dec', 'e4d25b47-0651-4d1b-919f-af97002b9346'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:17 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" returned: 0 in 0.826s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e25d70-d676-4319-aa3c-fd116d6ac9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc6dae2-fa2d-46a9-9027-25c0979ba161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:17 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Volume volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 (bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2): created successfully Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc6dae2-fa2d-46a9-9027-25c0979ba161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (517780e6-bba2-4ba0-ad4f-85a391ab6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Delete snapshot completed successfully. Jul 07 22:34:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-20770fa2-693b-4fd7-a81b-684cfd0e9282 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-c1ef979a-44c0-46af-b0a8-79f2a13da87e-delete_snapshot" released by "delete_snapshot" :: held 4.719s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d45b5dad-5688-4d5c-ba4e-eb17f4b7bc6e tempest-VolumesGetTest-1033219681 None] Created volume successfully. Jul 07 22:34:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Creating offline snapshot 79703254-bc92-4bee-a111-b502178f2486 of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:34:18 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc71bc52-614d-4be3-99ef-ce2abe1e40ae]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:18 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:34:18 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-e1e9bb5c-b775-4a3a-8e30-d0d840e8dd4e req-0fb9eae9-877b-47bc-9e4a-638c9fda3e54 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (a334800d-af58-4dfa-bb8c-57aba1c2c9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17a1d8b-fd87-4fab-b1f2-55119e7a5ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17a1d8b-fd87-4fab-b1f2-55119e7a5ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-889648231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:19Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a52d21-ea91-40fc-aac4-d7ac32edb890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a52d21-ea91-40fc-aac4-d7ac32edb890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e685f5-b532-4ade-959e-9135389e7df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e685f5-b532-4ade-959e-9135389e7df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1', 'volume_name': 'volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1', 'volume_size': 1, 'source_volid': 'bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2', 'source_volstatus': 'available'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b64b9c-9c7d-4b8b-a6ba-1761f54bf102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b64b9c-9c7d-4b8b-a6ba-1761f54bf102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519e0ede-0782-4714-b4a9-d831c6e16898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:19 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Volume 1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1', 'volume_size': 1, 'source_volid': 'bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2', 'source_volstatus': 'available'} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:19 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.129s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:19 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 1G Jul 07 22:34:19 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:20 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 1G" returned: 0 in 1.061s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:20 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 Jul 07 22:34:20 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:21 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:21 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 is being set with open permissions: ugo+rw Jul 07 22:34:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:21 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 Jul 07 22:34:21 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:22 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486" returned: 0 in 0.815s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.942s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-e1e9bb5c-b775-4a3a-8e30-d0d840e8dd4e req-0fb9eae9-877b-47bc-9e4a-638c9fda3e54 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.468s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:22 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[108d84ab-1a31-430e-881a-ceafc5f33ed3]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-e1e9bb5c-b775-4a3a-8e30-d0d840e8dd4e req-0fb9eae9-877b-47bc-9e4a-638c9fda3e54 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-77569353-f2f9-403f-a4c2-0a282d7a0615 tempest-SnapshotsActionsTest-1050584359 None] Create snapshot completed successfully Jul 07 22:34:22 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 Jul 07 22:34:22 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-79703254-bc92-4bee-a111-b502178f2486-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-79703254-bc92-4bee-a111-b502178f2486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Acquiring lock "cinder-quobyte-79703254-bc92-4bee-a111-b502178f2486" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-79703254-bc92-4bee-a111-b502178f2486" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Deleting offline snapshot 79703254-bc92-4bee-a111-b502178f2486 of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] snapshot_file for this snap is: volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d197faaa-6a56-46c9-bc02-19b531bbab0b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:23 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 Jul 07 22:34:23 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:23 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-e1e9bb5c-b775-4a3a-8e30-d0d840e8dd4e req-0fb9eae9-877b-47bc-9e4a-638c9fda3e54 tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6" returned: 0 in 0.980s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-e1e9bb5c-b775-4a3a-8e30-d0d840e8dd4e req-0fb9eae9-877b-47bc-9e4a-638c9fda3e54 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.234s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:23 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Cloning volume bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 to volume 1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Creating offline snapshot b643e9f8-0769-4ca6-aca2-f790021472ae of volume bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-e1e9bb5c-b775-4a3a-8e30-d0d840e8dd4e req-0fb9eae9-877b-47bc-9e4a-638c9fda3e54 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-9cf01f6f-2043-48bc-9493-1b563b2465b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed5743df-1ab1-4704-9d43-00d83406b076', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ff298-23a9-46dc-92b1-1ea43b2a8996]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-e1e9bb5c-b775-4a3a-8e30-d0d840e8dd4e req-0fb9eae9-877b-47bc-9e4a-638c9fda3e54 tempest-TestServerVolumeAttachmentScenario-1522483146 None] attachment_update completed successfully. Jul 07 22:34:23 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 Jul 07 22:34:23 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:24 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486" returned: 0 in 1.211s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:24 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9eeb34-2a31-4cbd-a7ac-076437be34ee]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:24 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:34:24 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:24 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" returned: 0 in 1.185s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:24 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae 1G Jul 07 22:34:24 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:25 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.082s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:25 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 Jul 07 22:34:25 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:26 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae 1G" returned: 0 in 1.131s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:26 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae Jul 07 22:34:26 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:26 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486" returned: 0 in 1.062s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:26 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486 Jul 07 22:34:26 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:26 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae" returned: 0 in 0.880s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:26 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae is being set with open permissions: ugo+rw Jul 07 22:34:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:26 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae Jul 07 22:34:26 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:27 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.79703254-bc92-4bee-a111-b502178f2486" returned: 0 in 0.788s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-79703254-bc92-4bee-a111-b502178f2486" released by "_delete_snapshot" :: held 4.286s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" released by "delete_snapshot" :: held 4.328s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:27 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Created reservations ['b3a6ce65-0619-4a83-9b0d-1c957baf708c', '9d54ca35-03c5-4bd1-a03a-f6ef8cd84b2c', '17429203-d5c8-4cfc-900f-d498193debff', '0b256c4d-85e5-41b7-801d-009b81e9452c'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:27 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae" returned: 0 in 0.806s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:27 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.info Jul 07 22:34:27 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:27 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Delete snapshot completed successfully. Jul 07 22:34:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-eb1815b1-132b-43f2-bba5-aa9c437962e3 tempest-SnapshotsActionsTest-1537876968 None] Lock "cinder-79703254-bc92-4bee-a111-b502178f2486-delete_snapshot" released by "delete_snapshot" :: held 4.568s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:28 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.info" returned: 0 in 0.729s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:28 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.info is being set with open permissions: ugo+rw Jul 07 22:34:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:28 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.info Jul 07 22:34:28 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "cinder-07c8975b-5131-4a31-ad8d-f5f8309870ae-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-07c8975b-5131-4a31-ad8d-f5f8309870ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "cinder-quobyte-07c8975b-5131-4a31-ad8d-f5f8309870ae" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-quobyte-07c8975b-5131-4a31-ad8d-f5f8309870ae" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Deleting offline snapshot 07c8975b-5131-4a31-ad8d-f5f8309870ae of volume 32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] snapshot_file for this snap is: volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b802ae3-9c87-4a64-ad03-1a98175b85ce]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:29 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.info" returned: 0 in 0.875s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] snapshot: b643e9f8-0769-4ca6-aca2-f790021472ae, volume: 1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b82dc3-1655-4109-8e8f-0923f1ae87c1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:29 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:34:29 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:29 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae Jul 07 22:34:29 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:30 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.128s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32272408-505c-44d4-ac21-ed94b4a9422e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f1a80-5f9a-4ff9-9029-b4ebd371b4ff]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:30 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e Jul 07 22:34:30 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:30 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae" returned: 0 in 1.149s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[834593a0-bce8-40cd-8315-bb17460be47d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:30 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 Jul 07 22:34:30 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:31 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e" returned: 0 in 1.183s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:31 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:34:31 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:31 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" returned: 0 in 1.273s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:31 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:34:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:32 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 Jul 07 22:34:32 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:32 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.107s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:32 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae Jul 07 22:34:32 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:34 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e.07c8975b-5131-4a31-ad8d-f5f8309870ae" returned: 0 in 1.710s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-quobyte-07c8975b-5131-4a31-ad8d-f5f8309870ae" released by "_delete_snapshot" :: held 5.408s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" released by "delete_snapshot" :: held 5.450s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:34 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Created reservations ['e3793681-155b-4211-8503-e5e385320199', 'e758fccd-64bc-468e-b4ec-b1ea9742ca29', '3baeb900-9fbe-4d80-b593-12a9771bea68', '1fbabb3b-c46d-41e4-ab74-08c6e08a056c'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Delete snapshot completed successfully. Jul 07 22:34:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aae67039-e46e-4dea-9fbb-9b3972a7daf9 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-07c8975b-5131-4a31-ad8d-f5f8309870ae-delete_snapshot" released by "delete_snapshot" :: held 5.841s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-4ba2473f-ad37-429b-aa96-a216c71503cf req-5830e9bd-12f2-4992-8e56-dc684037328e tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "cinder-32272408-505c-44d4-ac21-ed94b4a9422e-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-32272408-505c-44d4-ac21-ed94b4a9422e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" acquired by "delete_volume" :: waited 0.048s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf98529-c69d-483f-b06d-b2a847378ccd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:37 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e Jul 07 22:34:37 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:37 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:DELETE=8,cinder:UPDATE=71,cinder:SELECT=63,cinder:INSERT=21 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:34:39 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e" returned: 0 in 2.304s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:39 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e Jul 07 22:34:39 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:39 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" returned: 0 in 7.760s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:39 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b3acef-3959-4904-92e3-ce8558a838bb]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:40 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 Jul 07 22:34:40 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:40 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-32272408-505c-44d4-ac21-ed94b4a9422e" returned: 0 in 1.416s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-quobyte-32272408-505c-44d4-ac21-ed94b4a9422e" released by "delete_volume" :: held 3.859s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Created reservations ['3f3e97f7-7090-4e7e-b8dd-a876947e473c', 'f3501b56-773d-49df-b674-7dbdb61ef37a', '9a0c36bb-8428-424f-9ff8-cc2e1ebbe383', 'a706e686-e714-436a-a9e3-c27cf6696683'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:40 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:34:40 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:41 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" returned: 0 in 1.401s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:41 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2, size 1024.00 MB, duration 7.76 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:34:41 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Converted 1024.00 MB image at 131.92 MB/s Jul 07 22:34:41 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 is being set with open permissions: ugo+rw Jul 07 22:34:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:41 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 Jul 07 22:34:41 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:41 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.985s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:41 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:34:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Deleted volume successfully. Jul 07 22:34:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-83c93799-b60d-4a2e-a3ea-e80c64532731 tempest-SnapshotsActionsTest-1050584359 None] Lock "cinder-32272408-505c-44d4-ac21-ed94b4a9422e-delete_volume" released by "delete_volume" :: held 5.274s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:42 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" returned: 0 in 1.193s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" released by "_copy_volume_from_snapshot" :: held 12.961s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-b643e9f8-0769-4ca6-aca2-f790021472ae" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-b643e9f8-0769-4ca6-aca2-f790021472ae" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Deleting offline snapshot b643e9f8-0769-4ca6-aca2-f790021472ae of volume bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:34:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] snapshot_file for this snap is: volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:34:42 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b21c8d-264f-424a-8985-30259760bebb]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:42 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae Jul 07 22:34:42 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:43 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae" returned: 0 in 1.079s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:34:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbebbb2-edde-4765-8e2d-fa7b7b31b16e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:43 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 Jul 07 22:34:43 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:44 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" returned: 0 in 1.253s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:44 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae Jul 07 22:34:44 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (a145d831-97ff-4571-9cf1-7b40b9a83569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5d6f86-0a7b-4aa8-8bbd-461f83f60a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5d6f86-0a7b-4aa8-8bbd-461f83f60a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1112120911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8aeefd-1c07-4494-8de3-8256db0f3608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:45Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e331bc5-ce3b-4162-8dcc-b2c9268aba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e331bc5-ce3b-4162-8dcc-b2c9268aba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8257b29f-5bc3-4816-a0b7-09cf9b449e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8257b29f-5bc3-4816-a0b7-09cf9b449e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8aeefd-1c07-4494-8de3-8256db0f3608', 'volume_name': 'volume-8d8aeefd-1c07-4494-8de3-8256db0f3608', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d70ca3b-d01b-463d-ba95-56d13464d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d70ca3b-d01b-463d-ba95-56d13464d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93e91bc-b0c1-4bdb-a0ee-afa98eb521be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:45 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Volume 8d8aeefd-1c07-4494-8de3-8256db0f3608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8aeefd-1c07-4494-8de3-8256db0f3608', 'volume_size': 1} Jul 07 22:34:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:46 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae" returned: 0 in 1.342s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:46 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae Jul 07 22:34:46 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:47 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2.b643e9f8-0769-4ca6-aca2-f790021472ae" returned: 0 in 0.826s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-b643e9f8-0769-4ca6-aca2-f790021472ae" released by "_delete_snapshot" :: held 4.677s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.575s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-4ba2473f-ad37-429b-aa96-a216c71503cf req-5830e9bd-12f2-4992-8e56-dc684037328e tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.746s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519e0ede-0782-4714-b4a9-d831c6e16898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1', 'volume_size': 1, 'source_volid': 'bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2', 'source_volstatus': 'available'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00d7bcd-60dd-476c-a3f9-15279b88b69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7a1030-47ab-488f-9dde-b29e29c9ac77]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-4ba2473f-ad37-429b-aa96-a216c71503cf req-5830e9bd-12f2-4992-8e56-dc684037328e tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:47 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Volume volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 (1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1): created successfully Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00d7bcd-60dd-476c-a3f9-15279b88b69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (a334800d-af58-4dfa-bb8c-57aba1c2c9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:47 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-18b10eea-ed0e-47a9-9525-0c299507ea7e tempest-VolumesGetTest-1033219681 None] Created volume successfully. Jul 07 22:34:47 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 Jul 07 22:34:47 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:48 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-4ba2473f-ad37-429b-aa96-a216c71503cf req-5830e9bd-12f2-4992-8e56-dc684037328e tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297" returned: 0 in 1.212s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-4ba2473f-ad37-429b-aa96-a216c71503cf req-5830e9bd-12f2-4992-8e56-dc684037328e tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.254s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.843s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1112120911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8aeefd-1c07-4494-8de3-8256db0f3608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:45Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Creating volume 8d8aeefd-1c07-4494-8de3-8256db0f3608 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:34:48 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:48 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 1073741824 Jul 07 22:34:48 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-4ba2473f-ad37-429b-aa96-a216c71503cf req-5830e9bd-12f2-4992-8e56-dc684037328e tempest-TestServerVolumeAttachmentScenario-1522483146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96cafbb1-cb71-4c42-866b-f07249193ed7', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:34:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-4ba2473f-ad37-429b-aa96-a216c71503cf req-5830e9bd-12f2-4992-8e56-dc684037328e tempest-TestServerVolumeAttachmentScenario-1522483146 None] attachment_update completed successfully. Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (f8155c4c-2487-4813-bac9-3d4ea3efe2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b768c1a4-48eb-40ca-a4b9-6d5f2542efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b768c1a4-48eb-40ca-a4b9-6d5f2542efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-225471605',display_name='tempest-VolumesGetTest-Volume-1893980819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d4b7b5-3488-4fd1-a3e6-96278c7659d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:49Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b30a2b-79ee-4472-897d-5634956e1455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b30a2b-79ee-4472-897d-5634956e1455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55cdb26-a381-46e5-a5fe-714599f85c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55cdb26-a381-46e5-a5fe-714599f85c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d4b7b5-3488-4fd1-a3e6-96278c7659d1', 'volume_name': 'volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dcfe8a-7910-4379-b0e9-c4c907f85c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dcfe8a-7910-4379-b0e9-c4c907f85c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84ac623-9ff0-44b9-a672-a86c4807f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:49 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Volume a3d4b7b5-3488-4fd1-a3e6-96278c7659d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1', 'volume_size': 1} Jul 07 22:34:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:49 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 1073741824" returned: 0 in 1.436s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:50 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 Jul 07 22:34:50 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:50 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608" returned: 0 in 0.844s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.788s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:34:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-225471605',display_name='tempest-VolumesGetTest-Volume-1893980819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d4b7b5-3488-4fd1-a3e6-96278c7659d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:49Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Creating volume a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:34:50 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:50 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 1073741824 Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93e91bc-b0c1-4bdb-a0ee-afa98eb521be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8aeefd-1c07-4494-8de3-8256db0f3608', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:50 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5540a41c-2aa5-40b4-88ff-034bdc6b3b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:50 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Volume volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 (8d8aeefd-1c07-4494-8de3-8256db0f3608): created successfully Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5540a41c-2aa5-40b4-88ff-034bdc6b3b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (a145d831-97ff-4571-9cf1-7b40b9a83569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-34584f81-eef4-4947-8f26-ce04a9269d31 tempest-VolumesActionsTest-1337520735 None] Created volume successfully. Jul 07 22:34:51 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00a524d6-35f5-44a9-bbf7-14d6935edbe0 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608" by "attach_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 1073741824" returned: 0 in 1.132s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00a524d6-35f5-44a9-bbf7-14d6935edbe0 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608" acquired by "attach_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:52 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 Jul 07 22:34:52 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:52 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-00a524d6-35f5-44a9-bbf7-14d6935edbe0 tempest-VolumesActionsTest-1337520735 None] Attaching volume 8d8aeefd-1c07-4494-8de3-8256db0f3608 to instance d898e914-be2f-43c5-bd1d-43427f6eea05 at mountpoint /dev/vdb on host None. Jul 07 22:34:52 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-00a524d6-35f5-44a9-bbf7-14d6935edbe0 tempest-VolumesActionsTest-1337520735 None] Attach volume completed successfully. Jul 07 22:34:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00a524d6-35f5-44a9-bbf7-14d6935edbe0 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608" released by "attach_volume" :: held 0.182s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:53 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1" returned: 0 in 1.183s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:34:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84ac623-9ff0-44b9-a672-a86c4807f963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd1da9b-4460-4f6e-bb62-953bda456b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:34:53 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Volume volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 (a3d4b7b5-3488-4fd1-a3e6-96278c7659d1): created successfully Jul 07 22:34:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd1da9b-4460-4f6e-bb62-953bda456b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:34:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (f8155c4c-2487-4813-bac9-3d4ea3efe2dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:34:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3ea6f8e6-302a-45b4-ac51-73957e43159f tempest-VolumesGetTest-1033219681 None] Created volume successfully. Jul 07 22:34:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9fde134d-6888-4dfb-b87c-8d0fce8e3098 tempest-VolumesActionsTest-187799604 None] Terminate volume connection completed successfully. Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9fde134d-6888-4dfb-b87c-8d0fce8e3098 tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-detach_volume" by "detach_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9fde134d-6888-4dfb-b87c-8d0fce8e3098 tempest-VolumesActionsTest-187799604 None] Lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:54 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9fde134d-6888-4dfb-b87c-8d0fce8e3098 tempest-VolumesActionsTest-187799604 None] Detaching volume 8d8aeefd-1c07-4494-8de3-8256db0f3608 from instance d898e914-be2f-43c5-bd1d-43427f6eea05. Jul 07 22:34:54 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9fde134d-6888-4dfb-b87c-8d0fce8e3098 tempest-VolumesActionsTest-187799604 None] Detach volume completed successfully. Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9fde134d-6888-4dfb-b87c-8d0fce8e3098 tempest-VolumesActionsTest-187799604 None] Lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Lock "cinder-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4a5387-5a02-4baf-a6f5-e6ebe914d7f4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3dbeb7bf-91e9-4755-8103-5dfeab39930d tempest-VolumesActionsTest-1337520735 None] Acquiring lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-detach_volume" by "detach_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:54 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 Jul 07 22:34:54 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3dbeb7bf-91e9-4755-8103-5dfeab39930d tempest-VolumesActionsTest-1337520735 None] Lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:54 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3dbeb7bf-91e9-4755-8103-5dfeab39930d tempest-VolumesActionsTest-1337520735 None] Volume detach called, but volume not attached. Jul 07 22:34:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3dbeb7bf-91e9-4755-8103-5dfeab39930d tempest-VolumesActionsTest-1337520735 None] Lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:55 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1" returned: 0 in 0.961s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:55 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-919dae9f-82e6-49bd-a525-470f3ea08954 req-a34aca6b-d666-48f6-bcab-f6e4eb33a940 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Terminate volume connection completed successfully. Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-919dae9f-82e6-49bd-a525-470f3ea08954 req-a34aca6b-d666-48f6-bcab-f6e4eb33a940 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Deleting attachment 96cafbb1-cb71-4c42-866b-f07249193ed7. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:55 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1 Jul 07 22:34:55 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:55 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:34:55 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "cinder-quobyte-8d8aeefd-1c07-4494-8de3-8256db0f3608" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-quobyte-8d8aeefd-1c07-4494-8de3-8256db0f3608" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3d0318-279f-424b-9f2e-ae446ea982fb]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:56 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 Jul 07 22:34:56 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:56 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1" returned: 0 in 1.006s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1" released by "delete_volume" :: held 2.033s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:56 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.969s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Created reservations ['2cde2f21-ea6d-4a97-b6e5-d1dfb35848eb', 'c1aeb2d5-2cb6-4c91-bcb9-67b81d929368', '98b586f6-034e-43fa-9558-eb973faf0679', '0f61163d-1222-4065-8b49-05df5088857e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:57 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:34:57 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:57 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Lock "cinder-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608" returned: 0 in 1.321s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:57 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608 Jul 07 22:34:57 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" acquired by "delete_volume" :: waited 0.054s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb8bdc3-e99e-4c30-8801-bc509855ec85]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:34:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:57 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 Jul 07 22:34:57 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:58 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.373s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:34:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Deleted volume successfully. Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-90f56ecc-718a-470e-b863-57e030bd9bb4 tempest-VolumesGetTest-1033219681 None] Lock "cinder-a3d4b7b5-3488-4fd1-a3e6-96278c7659d1-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:58 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8d8aeefd-1c07-4494-8de3-8256db0f3608" returned: 0 in 1.301s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-quobyte-8d8aeefd-1c07-4494-8de3-8256db0f3608" released by "delete_volume" :: held 2.679s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Created reservations ['eed43c8a-9935-47d7-873b-9d98c330f99f', '1c065b70-a141-4ac6-8d1e-f455bc8f1e34', '834711a5-a676-4175-8cf7-478110803cfc', '95ba2cb4-ccee-4e99-9931-2eb005af6131'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:58 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:34:58 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:58 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" returned: 0 in 1.342s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:34:58 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1 Jul 07 22:34:58 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:34:59 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" returned: 0 in 0.977s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1" released by "delete_volume" :: held 2.415s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:59 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.112s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:34:59 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Deleted volume successfully. Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2363b8-de4f-4149-bf25-782b50354fe3 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-8d8aeefd-1c07-4494-8de3-8256db0f3608-delete_volume" released by "delete_volume" :: held 4.135s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Created reservations ['89bc478b-9b59-401c-90b7-6c308bbd226c', 'b61e25cc-9c82-4d58-9891-a0a9c33cef83', 'aeebd947-9948-4522-a27f-6643856dd3f9', '7329317d-17e4-4d59-a7c9-d3a9ef6dfba6'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:34:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:00 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:00 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-9a7edd8a-1236-4922-9dc3-3710d367df9f req-4924d453-caae-4d19-ad80-edc4cf51b99d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Terminate volume connection completed successfully. Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-9a7edd8a-1236-4922-9dc3-3710d367df9f req-4924d453-caae-4d19-ad80-edc4cf51b99d tempest-TestServerVolumeAttachmentScenario-1522483146 None] Deleting attachment ed5743df-1ab1-4704-9d43-00d83406b076. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Lock "cinder-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ce283-756d-48ff-b102-6e3fe2b14fb4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:00 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.001s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:00 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Deleted volume successfully. Jul 07 22:35:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a9a1d0c9-b3e9-4f3c-8a46-80ceb6704d1a tempest-VolumesGetTest-1033219681 None] Lock "cinder-1ff210b8-f91a-4c9b-b7c1-326f3bc6c3e1-delete_volume" released by "delete_volume" :: held 3.863s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:01 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 Jul 07 22:35:01 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:02 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" returned: 0 in 1.751s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:02 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2 Jul 07 22:35:02 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:03 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" returned: 0 in 0.834s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2" released by "delete_volume" :: held 2.677s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Created reservations ['e123ae0e-7c03-4a55-9242-2d1169ba3e8f', 'dfc5c038-fbb9-407a-aa92-b0d6d57ec4e9', 'b7184ec4-f6a4-450d-8dab-efcd1d14af40', '33442678-f766-47ab-9bc6-744a394359f2'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:03 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:03 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:04 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.119s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:04 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:04 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Deleted volume successfully. Jul 07 22:35:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6f9e3b60-58b7-4280-bd38-782dbf667456 tempest-VolumesGetTest-1033219681 None] Lock "cinder-bb1b0cb4-1948-4ba5-bcb7-9e570b08eaf2-delete_volume" released by "delete_volume" :: held 4.148s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (93d60f95-a856-4fbc-a8ba-f1f054b3f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4119e932-aeed-4c8f-b93c-8e09414886f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=103,cinder:INSERT=30,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4119e932-aeed-4c8f-b93c-8e09414886f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1555782249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e4d25d-9ecb-4487-90cd-4a40dde191ed,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:05Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c27d9b6-3ddc-439d-a7f9-a4e811cd9821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c27d9b6-3ddc-439d-a7f9-a4e811cd9821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c4bfb6-03a2-4b06-a1c3-c1c543efa6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:05 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:35:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c4bfb6-03a2-4b06-a1c3-c1c543efa6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47e4d25d-9ecb-4487-90cd-4a40dde191ed', 'volume_name': 'volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc711211-583b-4519-91d6-84bfe8ba92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc711211-583b-4519-91d6-84bfe8ba92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9150f8b9-0055-4a04-85e9-4b2b60e0fe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:06 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Volume 47e4d25d-9ecb-4487-90cd-4a40dde191ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:35:06 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Trying to clone 47e4d25d-9ecb-4487-90cd-4a40dde191ed from image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:35:06 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:35:06 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:35:06 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece31ad7-10d7-4fbc-87e1-a329b423c554]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:06 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD Jul 07 22:35:06 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:07 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD" returned: 0 in 0.990s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:07 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Temporary image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 is fetched for user ef2ca70081e1475889e62891294b52c0. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:35:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[34490d7f-2e4b-4d61-90cc-355009aee294]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:07 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD Jul 07 22:35:07 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:08 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD" returned: 0 in 1.069s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1555782249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e4d25d-9ecb-4487-90cd-4a40dde191ed,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:05Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Creating volume 47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:08 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:08 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed 1073741824 Jul 07 22:35:08 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (8de5579c-244f-4117-b55c-0d72c02c744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e229f6-bb83-4212-9027-7c15529dd2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e229f6-bb83-4212-9027-7c15529dd2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-105839847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5895e3-4fe3-48fb-bc21-a80ded58b7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:09Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca924f88-baba-4f41-9912-2d7c3907e521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca924f88-baba-4f41-9912-2d7c3907e521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a9e81a-bae7-4eb1-b5a7-559fb833fba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a9e81a-bae7-4eb1-b5a7-559fb833fba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5895e3-4fe3-48fb-bc21-a80ded58b7e1', 'volume_name': 'volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc1d909-16f5-4718-86e1-e689121becdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc1d909-16f5-4718-86e1-e689121becdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02697f44-186a-4feb-a6c5-db9ca1b3b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:09 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Volume 5d5895e3-4fe3-48fb-bc21-a80ded58b7e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1', 'volume_size': 1} Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:09 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed 1073741824" returned: 0 in 1.068s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:10 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed Jul 07 22:35:10 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:10 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed" returned: 0 in 0.821s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-105839847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5895e3-4fe3-48fb-bc21-a80ded58b7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:09Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Creating volume 5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:10 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:10 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 1073741824 Jul 07 22:35:10 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:10 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Attempting download of 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}])) to volume 47e4d25d-9ecb-4487-90cd-4a40dde191ed. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:35:11 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d0f0fe-e7ad-4af0-b127-f7d0e73a2eb5]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_sxuj3mzr {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:11 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_sxuj3mzr Jul 07 22:35:11 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:12 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_sxuj3mzr" returned: 0 in 0.991s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_sxuj3mzr {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:12 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_sxuj3mzr Jul 07 22:35:12 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:12 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 1073741824" returned: 0 in 1.392s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:12 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 Jul 07 22:35:12 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "cinder-c42a14b4-bc01-45d1-b0fa-9310ad83d297-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "cinder-c42a14b4-bc01-45d1-b0fa-9310ad83d297-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "cinder-quobyte-c42a14b4-bc01-45d1-b0fa-9310ad83d297" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "cinder-quobyte-c42a14b4-bc01-45d1-b0fa-9310ad83d297" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:12 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_sxuj3mzr" returned: 1 in 0.943s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_sxuj3mzr' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[26941d45-6086-4048-8036-98750d75e8df]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac86d6-ec22-4fde-8ed4-da416ae6d823]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:13 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD Jul 07 22:35:13 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:13 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 Jul 07 22:35:13 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:13 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1" returned: 0 in 0.950s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] <== create_volume: return (2436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.441s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02697f44-186a-4feb-a6c5-db9ca1b3b07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ed8cd4-74e4-444e-9d4c-bd7d263d6648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:13 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Volume volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 (5d5895e3-4fe3-48fb-bc21-a80ded58b7e1): created successfully Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ed8cd4-74e4-444e-9d4c-bd7d263d6648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (8de5579c-244f-4117-b55c-0d72c02c744a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ac82d545-c4ee-42c5-87b1-1626e3b40d40 tempest-VolumesActionsTest-1337520735 None] Created volume successfully. Jul 07 22:35:13 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD" returned: 0 in 0.978s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 was qcow2, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:13 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:13 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed Jul 07 22:35:13 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297" returned: 0 in 1.020s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:14 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297 Jul 07 22:35:14 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Flow 'volume_create_manager' (77b7a1f6-af08-4be3-9c59-c0d0dee46bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d078ed44-184b-44e4-92eb-893c939734db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d078ed44-184b-44e4-92eb-893c939734db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-522693628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5223ce3f-adb7-4956-81ba-6a0c04b558d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535814c1865147e8a709be578f36ca01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:14Z,use_quota=True,user_id='f42eacaa9f4d40cfaf71b0f91b54da80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63774ab3-36a9-42f8-81e1-b23155980a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63774ab3-36a9-42f8-81e1-b23155980a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d888a42-6e9b-4b79-b7f6-19892236999b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d888a42-6e9b-4b79-b7f6-19892236999b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5223ce3f-adb7-4956-81ba-6a0c04b558d4', 'volume_name': 'volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc82f72-a0c3-4275-8547-d4cbf036d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc82f72-a0c3-4275-8547-d4cbf036d712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cdf0ee-ac13-4c41-afd3-dbafd8c1026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:14 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Volume 5223ce3f-adb7-4956-81ba-6a0c04b558d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4', 'volume_size': 1} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-522693628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5223ce3f-adb7-4956-81ba-6a0c04b558d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535814c1865147e8a709be578f36ca01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:14Z,use_quota=True,user_id='f42eacaa9f4d40cfaf71b0f91b54da80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Creating volume 5223ce3f-adb7-4956-81ba-6a0c04b558d4 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:14 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:14 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 1073741824 Jul 07 22:35:14 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Lock "cinder-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:14 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c42a14b4-bc01-45d1-b0fa-9310ad83d297" returned: 0 in 0.840s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-quobyte-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "cinder-quobyte-c42a14b4-bc01-45d1-b0fa-9310ad83d297" released by "delete_volume" :: held 1.941s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Lock "cinder-quobyte-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6d00ea-706f-4400-a584-3c98645ebcc9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:14 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Created reservations ['b5cc24fb-3776-4adf-8fbe-a1d019e5b65d', 'ca64bb15-6258-4a98-9a87-b9f8e41a4126', '74629016-32ba-4342-867c-015bfe103663', '12c09b79-2dcb-4fda-ae91-bb2ba99a1887'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:15 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 Jul 07 22:35:15 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:15 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:15 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:15 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 1073741824" returned: 0 in 1.190s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:15 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 Jul 07 22:35:15 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:16 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1" returned: 0 in 1.094s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:16 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:16 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1 Jul 07 22:35:16 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.926s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:16 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Deleted volume successfully. Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a6ea44ac-a1a8-4d11-ad94-e7f99ebba96b tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "cinder-c42a14b4-bc01-45d1-b0fa-9310ad83d297-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "cinder-9cf01f6f-2043-48bc-9493-1b563b2465b6-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "cinder-9cf01f6f-2043-48bc-9493-1b563b2465b6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "cinder-quobyte-9cf01f6f-2043-48bc-9493-1b563b2465b6" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "cinder-quobyte-9cf01f6f-2043-48bc-9493-1b563b2465b6" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[942982cc-bd95-41c1-97f2-7369cc50abbf]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:16 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 Jul 07 22:35:16 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:16 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4" returned: 0 in 0.812s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cdf0ee-ac13-4c41-afd3-dbafd8c1026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc9bde6-7341-47ee-b224-01b5f1c6bf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:16 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Volume volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 (5223ce3f-adb7-4956-81ba-6a0c04b558d4): created successfully Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc9bde6-7341-47ee-b224-01b5f1c6bf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Flow 'volume_create_manager' (77b7a1f6-af08-4be3-9c59-c0d0dee46bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:16 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed" returned: 0 in 2.769s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_a2ixz3w8devstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:35:16 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Converted 112.00 MB image at 40.44 MB/s Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:16 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-34858374-4979-4e26-adb9-0ab087e477a0 tempest-VolumeQuotasAdminTestJSON-396187658 None] Created volume successfully. Jul 07 22:35:16 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed 1G Jul 07 22:35:16 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:16 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1" returned: 0 in 0.906s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Lock "cinder-quobyte-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1" released by "delete_volume" :: held 2.054s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Created reservations ['75694a24-35b2-440b-b1e2-f2437e034d06', '3453de1a-2be3-4dd9-a9e6-f02f63abd667', 'a28fa5e9-67a8-43d0-a118-e8de969f5b02', '5aac598d-2827-4c15-b651-8c17f983b0af'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:17 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:17 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:17 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6" returned: 0 in 0.911s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:17 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6 Jul 07 22:35:17 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:17 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed 1G" returned: 0 in 0.791s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e53fb27-1592-43be-964a-14550e728245]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:17 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed Jul 07 22:35:17 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Acquiring lock "cinder-5223ce3f-adb7-4956-81ba-6a0c04b558d4-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "cinder-5223ce3f-adb7-4956-81ba-6a0c04b558d4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Acquiring lock "cinder-quobyte-5223ce3f-adb7-4956-81ba-6a0c04b558d4" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "cinder-quobyte-5223ce3f-adb7-4956-81ba-6a0c04b558d4" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7e82b5-7e0b-402f-b8a0-6b62c6144ea2]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:17 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.776s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Deleted volume successfully. Jul 07 22:35:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-13bacd49-7796-4525-8aba-96443de16c21 tempest-VolumesActionsTest-187799604 None] Lock "cinder-5d5895e3-4fe3-48fb-bc21-a80ded58b7e1-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:18 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 Jul 07 22:35:18 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:18 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9cf01f6f-2043-48bc-9493-1b563b2465b6" returned: 0 in 0.930s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "cinder-quobyte-9cf01f6f-2043-48bc-9493-1b563b2465b6" released by "delete_volume" :: held 1.904s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Created reservations ['7ab2095d-8780-4af5-b99b-2f04f621dd5f', '14a56751-c435-4157-9899-3e63bc90e28d', '941b508f-4f56-49c3-8049-6d2a5f1676e2', '49495507-4231-4a12-99f6-a99b89fce0ac'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:18 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:18 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:18 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed" returned: 0 in 1.196s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:19 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed Jul 07 22:35:19 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:19 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (c82a3505-9629-4432-8b26-ae8f033f1e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f378a8-a0d9-4699-8ab2-cea116c9b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4" returned: 0 in 1.310s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f378a8-a0d9-4699-8ab2-cea116c9b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-72312937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81109fb-efd3-4daa-bad5-6e414231e4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:19Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:19 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4 Jul 07 22:35:19 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef22a019-b836-4272-955a-3c5f81058011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef22a019-b836-4272-955a-3c5f81058011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3e253a-d7b6-4f14-8e0a-e8c9d231f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3e253a-d7b6-4f14-8e0a-e8c9d231f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c81109fb-efd3-4daa-bad5-6e414231e4d7', 'volume_name': 'volume-c81109fb-efd3-4daa-bad5-6e414231e4d7', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4100be90-3a27-43c9-ac4d-1a05e05bab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4100be90-3a27-43c9-ac4d-1a05e05bab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373a79c5-a6fd-4d0f-b8e7-872148cc98da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:19 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Volume c81109fb-efd3-4daa-bad5-6e414231e4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c81109fb-efd3-4daa-bad5-6e414231e4d7', 'volume_size': 1} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-72312937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81109fb-efd3-4daa-bad5-6e414231e4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:19Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Creating volume c81109fb-efd3-4daa-bad5-6e414231e4d7 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:19 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:19 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 1073741824 Jul 07 22:35:19 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:19 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.027s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Deleted volume successfully. Jul 07 22:35:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ec3c86d-85c5-425f-a80d-3942c4a7a948 tempest-TestServerVolumeAttachmentScenario-1522483146 None] Lock "cinder-9cf01f6f-2043-48bc-9493-1b563b2465b6-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:20 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed" returned: 1 in 1.355s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Downloaded image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}])) to volume 47e4d25d-9ecb-4487-90cd-4a40dde191ed successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Temporary image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 for user ef2ca70081e1475889e62891294b52c0 is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Marking volume 47e4d25d-9ecb-4487-90cd-4a40dde191ed as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Copying metadata from image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 to 47e4d25d-9ecb-4487-90cd-4a40dde191ed. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Creating volume glance metadata for volume 47e4d25d-9ecb-4487-90cd-4a40dde191ed backed by image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9150f8b9-0055-4a04-85e9-4b2b60e0fe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16098634-360b-402e-beac-8933244c263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:20 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Volume volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed (47e4d25d-9ecb-4487-90cd-4a40dde191ed): created successfully Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16098634-360b-402e-beac-8933244c263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (93d60f95-a856-4fbc-a8ba-f1f054b3f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:20 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3dfcbaed-0ac6-463e-9e70-c3aa7569d5e9 tempest-VolumesGetTest-1033219681 None] Created volume successfully. Jul 07 22:35:20 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5223ce3f-adb7-4956-81ba-6a0c04b558d4" returned: 0 in 1.169s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "cinder-quobyte-5223ce3f-adb7-4956-81ba-6a0c04b558d4" released by "delete_volume" :: held 2.528s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Created reservations ['d8c9e5b9-ffa8-4a2f-a63d-2fc87ea11972', '36d27056-f015-492c-b96e-3c946de39440', '8e634a6b-f3f6-4d0c-b305-2212ed7d649e', 'd47a83ad-01dc-4918-8504-f12402ef5d28'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:20 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:20 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:20 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 1073741824" returned: 0 in 1.320s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:20 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 Jul 07 22:35:20 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:21 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.240s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:21 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:21 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Deleted volume successfully. Jul 07 22:35:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3d7b80f9-6f62-4b21-9afd-40b2c2648cab tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "cinder-5223ce3f-adb7-4956-81ba-6a0c04b558d4-delete_volume" released by "delete_volume" :: held 4.099s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:21 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7" returned: 0 in 1.276s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] <== create_volume: return (2673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.675s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373a79c5-a6fd-4d0f-b8e7-872148cc98da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c81109fb-efd3-4daa-bad5-6e414231e4d7', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab830e37-a139-453b-bf1d-5650dbe3d750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Volume volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 (c81109fb-efd3-4daa-bad5-6e414231e4d7): created successfully Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab830e37-a139-453b-bf1d-5650dbe3d750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (c82a3505-9629-4432-8b26-ae8f033f1e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7f83c95f-bb7b-42de-a090-8f70e1fdc3a1 tempest-VolumesActionsTest-1337520735 None] Created volume successfully. Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (001eaa55-c80a-472a-bc86-16d7e6597a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde8abc5-d741-4c94-8074-039b823d7e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde8abc5-d741-4c94-8074-039b823d7e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1169252410',display_name='tempest-VolumesGetTest-Volume-581019196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147789d8-20b1-4b7e-8a44-f56f2e150636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:22Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbe2711-f83b-4ba5-aa13-c9c76af4ac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbe2711-f83b-4ba5-aa13-c9c76af4ac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc9604c-b25a-4a83-bb63-8d028003d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc9604c-b25a-4a83-bb63-8d028003d43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '147789d8-20b1-4b7e-8a44-f56f2e150636', 'volume_name': 'volume-147789d8-20b1-4b7e-8a44-f56f2e150636', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac313b9a-9d50-48c8-a3ff-b5884064f96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac313b9a-9d50-48c8-a3ff-b5884064f96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44630a0a-7324-44cd-80f3-2da650b35f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Volume 147789d8-20b1-4b7e-8a44-f56f2e150636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-147789d8-20b1-4b7e-8a44-f56f2e150636', 'volume_size': 1} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1169252410',display_name='tempest-VolumesGetTest-Volume-581019196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147789d8-20b1-4b7e-8a44-f56f2e150636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f231025af28444cca8f247596582cf6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:22Z,use_quota=True,user_id='ef2ca70081e1475889e62891294b52c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Creating volume 147789d8-20b1-4b7e-8a44-f56f2e150636 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:22 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:22 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 1073741824 Jul 07 22:35:22 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-c81109fb-efd3-4daa-bad5-6e414231e4d7-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Flow 'volume_create_manager' (55d48c48-47dd-4b4c-bf70-4467ab23ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce17a00-bcc6-406b-9f04-8583286f84e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce17a00-bcc6-406b-9f04-8583286f84e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-426594587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62acdb7-08bb-4299-a79f-561b904d32a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535814c1865147e8a709be578f36ca01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:22Z,use_quota=True,user_id='f42eacaa9f4d40cfaf71b0f91b54da80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2146142f-ce67-4e33-84a8-57a79c735220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2146142f-ce67-4e33-84a8-57a79c735220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c13c35-3e7c-441c-9748-6f73fae339c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c13c35-3e7c-441c-9748-6f73fae339c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62acdb7-08bb-4299-a79f-561b904d32a9', 'volume_name': 'volume-f62acdb7-08bb-4299-a79f-561b904d32a9', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cf7b29-20f3-49aa-b887-41f1345ed4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cf7b29-20f3-49aa-b887-41f1345ed4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04857a5-b3fe-40cd-88dc-e6d9c901551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Volume f62acdb7-08bb-4299-a79f-561b904d32a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62acdb7-08bb-4299-a79f-561b904d32a9', 'volume_size': 1} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Lock "cinder-c81109fb-efd3-4daa-bad5-6e414231e4d7-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-quobyte-c81109fb-efd3-4daa-bad5-6e414231e4d7" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Lock "cinder-quobyte-c81109fb-efd3-4daa-bad5-6e414231e4d7" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9ecf01-ab04-480e-ac61-892d6b6847ef]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:22 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 Jul 07 22:35:22 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:23 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 1073741824" returned: 0 in 1.224s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:23 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 Jul 07 22:35:23 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:23 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7" returned: 0 in 1.165s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:23 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7 Jul 07 22:35:23 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:24 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636" returned: 0 in 0.810s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-426594587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62acdb7-08bb-4299-a79f-561b904d32a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535814c1865147e8a709be578f36ca01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:22Z,use_quota=True,user_id='f42eacaa9f4d40cfaf71b0f91b54da80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Creating volume f62acdb7-08bb-4299-a79f-561b904d32a9 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:24 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44630a0a-7324-44cd-80f3-2da650b35f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-147789d8-20b1-4b7e-8a44-f56f2e150636', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:24 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 1073741824 Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4ec36d-0a31-465e-b36d-691dabfee123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:24 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:24 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Volume volume-147789d8-20b1-4b7e-8a44-f56f2e150636 (147789d8-20b1-4b7e-8a44-f56f2e150636): created successfully Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4ec36d-0a31-465e-b36d-691dabfee123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Flow 'volume_create_manager' (001eaa55-c80a-472a-bc86-16d7e6597a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f94fe599-17a7-4c3c-956a-26d091afd21a tempest-VolumesGetTest-1033219681 None] Created volume successfully. Jul 07 22:35:24 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c81109fb-efd3-4daa-bad5-6e414231e4d7" returned: 0 in 0.898s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Lock "cinder-quobyte-c81109fb-efd3-4daa-bad5-6e414231e4d7" released by "delete_volume" :: held 2.130s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Created reservations ['775ccff3-2bbe-4ada-99f7-07bbdc950279', '962cedfb-dc0d-44e5-889e-34db58c13883', '6ff45dbf-7df8-4d94-adb5-453437d2df76', 'a3e21196-8e0a-4833-9725-5f5414d4cc2e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:25 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:25 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-147789d8-20b1-4b7e-8a44-f56f2e150636-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Lock "cinder-147789d8-20b1-4b7e-8a44-f56f2e150636-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-147789d8-20b1-4b7e-8a44-f56f2e150636" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-147789d8-20b1-4b7e-8a44-f56f2e150636" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:25 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e1ad64-7a2e-4572-a87e-bb3d77c42350]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:25 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 Jul 07 22:35:25 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:25 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 1073741824" returned: 0 in 1.109s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:25 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 Jul 07 22:35:25 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:26 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.084s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Deleted volume successfully. Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-14d7fcfd-52cc-4e84-9cdb-1a1118ec6059 tempest-VolumesActionsTest-187799604 None] Lock "cinder-c81109fb-efd3-4daa-bad5-6e414231e4d7-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:26 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636" returned: 0 in 1.191s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:26 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636 Jul 07 22:35:26 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:26 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (d676b368-ee5c-42e3-bb0a-6b3096f25bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6162913-95bc-4954-9d62-99bbfc94e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9" returned: 0 in 1.197s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.418s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04857a5-b3fe-40cd-88dc-e6d9c901551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62acdb7-08bb-4299-a79f-561b904d32a9', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91daaf5-b18a-4467-b6a0-27597074ec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6162913-95bc-4954-9d62-99bbfc94e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740775693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d753923-5fd0-4e8f-8f06-e2f16f24398b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:27Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9d6a91-aed7-4afa-8777-090ee63a76ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9d6a91-aed7-4afa-8777-090ee63a76ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe6a0e1-0579-4b31-9733-682bc5bc03c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe6a0e1-0579-4b31-9733-682bc5bc03c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d753923-5fd0-4e8f-8f06-e2f16f24398b', 'volume_name': 'volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdcb80d-8640-4a1f-b6f7-bc1e81668532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdcb80d-8640-4a1f-b6f7-bc1e81668532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a72086b-baa9-4779-ac97-318a392a98d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:27 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Volume 5d753923-5fd0-4e8f-8f06-e2f16f24398b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b', 'volume_size': 1} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740775693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d753923-5fd0-4e8f-8f06-e2f16f24398b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:27Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Creating volume 5d753923-5fd0-4e8f-8f06-e2f16f24398b {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:27 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:27 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Volume volume-f62acdb7-08bb-4299-a79f-561b904d32a9 (f62acdb7-08bb-4299-a79f-561b904d32a9): created successfully Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91daaf5-b18a-4467-b6a0-27597074ec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:27 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b 1073741824 Jul 07 22:35:27 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Flow 'volume_create_manager' (55d48c48-47dd-4b4c-bf70-4467ab23ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:27 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b5cf0ea1-fe90-4c9e-974d-58d14427e2bd tempest-VolumeQuotasAdminTestJSON-396187658 None] Created volume successfully. Jul 07 22:35:27 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-147789d8-20b1-4b7e-8a44-f56f2e150636" returned: 0 in 0.824s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-147789d8-20b1-4b7e-8a44-f56f2e150636" released by "delete_volume" :: held 2.074s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Created reservations ['48bf9796-3141-4b04-b220-416946d24f34', 'b4a498af-88ca-4a0e-8a0a-cd05d0ef1787', '2ef60283-10eb-4383-bb89-467ec88e3aeb', 'b295003d-b592-412a-9c82-2f5d8682d74c'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:27 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:27 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:28 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b 1073741824" returned: 0 in 1.255s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:28 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b Jul 07 22:35:28 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3158343b-c484-4f5d-898b-ff83d216ddab tempest-VolumeQuotasAdminTestJSON-408549152 None] Transfer volume completed successfully. Jul 07 22:35:28 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.890s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:28 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Deleted volume successfully. Jul 07 22:35:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c422cc50-a823-4232-8ae5-eb11a51de344 tempest-VolumesGetTest-1033219681 None] Lock "cinder-147789d8-20b1-4b7e-8a44-f56f2e150636-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-47e4d25d-9ecb-4487-90cd-4a40dde191ed-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Lock "cinder-47e4d25d-9ecb-4487-90cd-4a40dde191ed-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Acquiring lock "cinder-quobyte-47e4d25d-9ecb-4487-90cd-4a40dde191ed" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-47e4d25d-9ecb-4487-90cd-4a40dde191ed" acquired by "delete_volume" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664ed37-1ef1-44f5-9b75-415f94cdf75a]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:29 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed Jul 07 22:35:29 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:29 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b" returned: 0 in 1.091s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] <== create_volume: return (2436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.440s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a72086b-baa9-4779-ac97-318a392a98d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad82f27-1ad7-4301-8ec5-75fa1cce613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:29 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Volume volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b (5d753923-5fd0-4e8f-8f06-e2f16f24398b): created successfully Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad82f27-1ad7-4301-8ec5-75fa1cce613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (d676b368-ee5c-42e3-bb0a-6b3096f25bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b04cb064-37c1-4e56-ac38-bd9eda9d4873 tempest-VolumesActionsTest-1337520735 None] Created volume successfully. Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Acquiring lock "cinder-f62acdb7-08bb-4299-a79f-561b904d32a9-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Lock "cinder-f62acdb7-08bb-4299-a79f-561b904d32a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Acquiring lock "cinder-quobyte-f62acdb7-08bb-4299-a79f-561b904d32a9" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Lock "cinder-quobyte-f62acdb7-08bb-4299-a79f-561b904d32a9" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb81df37-0b3c-4189-8f14-cf38ea5c39e9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:30 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 Jul 07 22:35:30 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:30 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed" returned: 0 in 1.180s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-5d753923-5fd0-4e8f-8f06-e2f16f24398b-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Lock "cinder-5d753923-5fd0-4e8f-8f06-e2f16f24398b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:30 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed Jul 07 22:35:30 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-quobyte-5d753923-5fd0-4e8f-8f06-e2f16f24398b" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Lock "cinder-quobyte-5d753923-5fd0-4e8f-8f06-e2f16f24398b" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f96913-2749-465d-b4d9-684648015598]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:30 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b Jul 07 22:35:30 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:31 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed" returned: 1 in 1.158s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:35:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:31 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9" returned: 0 in 1.441s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:31 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed Jul 07 22:35:31 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:31 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9 Jul 07 22:35:31 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:31 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b" returned: 0 in 1.083s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:31 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b Jul 07 22:35:31 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:32 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-47e4d25d-9ecb-4487-90cd-4a40dde191ed" returned: 0 in 0.975s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Lock "cinder-quobyte-47e4d25d-9ecb-4487-90cd-4a40dde191ed" released by "delete_volume" :: held 3.432s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:32 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f62acdb7-08bb-4299-a79f-561b904d32a9" returned: 0 in 1.015s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Lock "cinder-quobyte-f62acdb7-08bb-4299-a79f-561b904d32a9" released by "delete_volume" :: held 2.584s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Created reservations ['1756e77a-fd3c-47d6-9ee2-9ac9408bab75', '4ee68e06-8240-4d9a-8345-615699c59b2c', '0ac5ea9d-f4f9-4823-9baf-b5017a2a805e', '26801daa-f5d3-4bd2-9053-f793691f12cd'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:32 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5d753923-5fd0-4e8f-8f06-e2f16f24398b" returned: 0 in 0.905s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Created reservations ['d0497148-cc83-4198-95ac-c9c21634bb72', '5600b64a-a4c0-4595-8362-ad8a60905f48', '9f6f5e63-1b37-416b-be5b-f94d541f250f', 'b57851f5-b153-409e-a571-8ced799d77db'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Lock "cinder-quobyte-5d753923-5fd0-4e8f-8f06-e2f16f24398b" released by "delete_volume" :: held 2.061s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:32 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:32 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:32 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Created reservations ['345fad39-dda7-4f71-bf54-3ec0956a7d4a', '69273afa-3b48-45c5-bc15-dd2be7cb8348', 'be7bb7d6-0c7e-4110-95c0-e3175e3c0f58', 'f8dfa922-f368-4ff5-80e0-42d5945ec9bd'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:32 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:32 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:33 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:33 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:33 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.085s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:33 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Deleted volume successfully. Jul 07 22:35:34 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.195s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Deleted volume successfully. Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-00ecc04e-657a-4254-8216-709e24282c01 tempest-VolumeQuotasAdminTestJSON-697590703 None] Lock "cinder-f62acdb7-08bb-4299-a79f-561b904d32a9-delete_volume" released by "delete_volume" :: held 4.145s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-12b57763-fafa-469e-8f2a-e49a32862b0d tempest-VolumesGetTest-1033219681 None] Lock "cinder-47e4d25d-9ecb-4487-90cd-4a40dde191ed-delete_volume" released by "delete_volume" :: held 5.104s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:34 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.161s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Deleted volume successfully. Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b40f16f5-01c8-4291-902c-3ba09f0bc92e tempest-VolumesActionsTest-187799604 None] Lock "cinder-5d753923-5fd0-4e8f-8f06-e2f16f24398b-delete_volume" released by "delete_volume" :: held 3.781s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (478fc85d-073c-4eff-81d9-0938c60c6f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0f8afb-58d9-4ab6-b460-7c01eac9738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0f8afb-58d9-4ab6-b460-7c01eac9738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-36789536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f842f3f7-4bb0-4c9a-8565-5054b547a0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:35Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028c3c88-88c3-4097-bafc-dbd6b005628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028c3c88-88c3-4097-bafc-dbd6b005628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd68f56-e7e4-445d-b450-32a405f82a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd68f56-e7e4-445d-b450-32a405f82a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f842f3f7-4bb0-4c9a-8565-5054b547a0e0', 'volume_name': 'volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e58466-524e-4474-81bb-902b2a51536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e58466-524e-4474-81bb-902b2a51536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ef01ad-a89b-493c-9c4f-117e786690a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:35 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Volume f842f3f7-4bb0-4c9a-8565-5054b547a0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0', 'volume_size': 1} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-36789536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f842f3f7-4bb0-4c9a-8565-5054b547a0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:35Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Creating volume f842f3f7-4bb0-4c9a-8565-5054b547a0e0 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:35 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:35 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 1073741824 Jul 07 22:35:35 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:36 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 1073741824" returned: 0 in 1.490s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:36 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 Jul 07 22:35:36 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:37 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0" returned: 0 in 1.236s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] <== create_volume: return (2800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.815s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ef01ad-a89b-493c-9c4f-117e786690a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25033487-9b1f-48fd-b4ed-d5e1f05e24ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:37 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Volume volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 (f842f3f7-4bb0-4c9a-8565-5054b547a0e0): created successfully Jul 07 22:35:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25033487-9b1f-48fd-b4ed-d5e1f05e24ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (478fc85d-073c-4eff-81d9-0938c60c6f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-fd748791-7436-459e-99e3-9bf6e5b50da6 tempest-VolumesActionsTest-1337520735 None] Created volume successfully. Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=103,cinder:INSERT=38,cinder:UPDATE=163,cinder:DELETE=13 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-f842f3f7-4bb0-4c9a-8565-5054b547a0e0-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Lock "cinder-f842f3f7-4bb0-4c9a-8565-5054b547a0e0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Acquiring lock "cinder-quobyte-f842f3f7-4bb0-4c9a-8565-5054b547a0e0" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Lock "cinder-quobyte-f842f3f7-4bb0-4c9a-8565-5054b547a0e0" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1a2fd7-d5b1-4151-a2ed-7739f09d579d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:38 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 Jul 07 22:35:38 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Flow 'volume_create_manager' (8f8a5930-0b95-4b86-b357-6543c23a3d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f947e0-77f2-494a-900f-f0048194eafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f947e0-77f2-494a-900f-f0048194eafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-471733536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a18fe5a-d309-4552-bf88-486121f8cd9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e85bbb91fe1d4114888bb9158a4fbabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:39Z,use_quota=True,user_id='5d638da0d42245c8b0f3ad623db1be85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682414a4-f513-4240-97b3-1a2634881b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682414a4-f513-4240-97b3-1a2634881b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9682a585-478c-4f58-b623-71c9a331c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9682a585-478c-4f58-b623-71c9a331c78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a18fe5a-d309-4552-bf88-486121f8cd9f', 'volume_name': 'volume-6a18fe5a-d309-4552-bf88-486121f8cd9f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f68572d-4a43-44d2-a05e-b212bd42c302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f68572d-4a43-44d2-a05e-b212bd42c302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f1bde7-bcc9-40bb-876a-2a3dd2cee517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:39 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Volume 6a18fe5a-d309-4552-bf88-486121f8cd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a18fe5a-d309-4552-bf88-486121f8cd9f', 'volume_size': 1} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-471733536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a18fe5a-d309-4552-bf88-486121f8cd9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e85bbb91fe1d4114888bb9158a4fbabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:39Z,use_quota=True,user_id='5d638da0d42245c8b0f3ad623db1be85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Creating volume 6a18fe5a-d309-4552-bf88-486121f8cd9f {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:39 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:39 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f 1073741824 Jul 07 22:35:39 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:39 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0" returned: 0 in 1.186s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:40 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0 Jul 07 22:35:40 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:40 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f 1073741824" returned: 0 in 1.356s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:40 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f Jul 07 22:35:40 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:41 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f842f3f7-4bb0-4c9a-8565-5054b547a0e0" returned: 0 in 1.081s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Lock "cinder-quobyte-f842f3f7-4bb0-4c9a-8565-5054b547a0e0" released by "delete_volume" :: held 2.358s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Created reservations ['ec123733-515e-4d96-80d8-3dc1ce00e0d2', '0a81ff34-dc65-4d86-95f9-c72a3d447dff', 'f6a55df3-3556-4535-8b9f-047b693afba6', '9422853c-9e38-4350-a825-b7efcf0a4800'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:41 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:41 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:41 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f" returned: 0 in 0.850s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f1bde7-bcc9-40bb-876a-2a3dd2cee517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a18fe5a-d309-4552-bf88-486121f8cd9f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff5f0dd-2bef-4709-8f58-e1acb4e93dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:41 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Volume volume-6a18fe5a-d309-4552-bf88-486121f8cd9f (6a18fe5a-d309-4552-bf88-486121f8cd9f): created successfully Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff5f0dd-2bef-4709-8f58-e1acb4e93dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Flow 'volume_create_manager' (8f8a5930-0b95-4b86-b357-6543c23a3d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9563c356-729d-4b70-ae1b-2259925c346d tempest-VolumesListTestJSON-1377236791 None] Created volume successfully. Jul 07 22:35:42 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.093s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:42 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:42 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Deleted volume successfully. Jul 07 22:35:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f6fd9a2a-26f7-4cf9-b2b0-9d277dd24a62 tempest-VolumesActionsTest-187799604 None] Lock "cinder-f842f3f7-4bb0-4c9a-8565-5054b547a0e0-delete_volume" released by "delete_volume" :: held 3.851s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (549dfb48-af29-4e7e-936d-36e21b3b5c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84cadbb-9d22-43b8-9ffe-4b079c0417fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84cadbb-9d22-43b8-9ffe-4b079c0417fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-542205412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9542c909-66d0-43a1-a58d-9f968411d18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:43Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b634f1fa-fe4d-46d7-93a1-1169521c05bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b634f1fa-fe4d-46d7-93a1-1169521c05bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3481f723-716e-4847-bf46-0a4311192e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3481f723-716e-4847-bf46-0a4311192e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9542c909-66d0-43a1-a58d-9f968411d18f', 'volume_name': 'volume-9542c909-66d0-43a1-a58d-9f968411d18f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6e7f88-403c-49d7-acbe-fdff26012bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6e7f88-403c-49d7-acbe-fdff26012bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a763eff6-5dd1-414e-b563-5a9e2eb12c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Volume 9542c909-66d0-43a1-a58d-9f968411d18f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9542c909-66d0-43a1-a58d-9f968411d18f', 'volume_size': 1} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-542205412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9542c909-66d0-43a1-a58d-9f968411d18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4127a2acf44ef096312d11965aa549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:43Z,use_quota=True,user_id='2450509e48fb43a58af7cf6b998b387a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Creating volume 9542c909-66d0-43a1-a58d-9f968411d18f {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:43 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:43 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f 1073741824 Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:43 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Flow 'volume_create_manager' (06e5aacf-d965-405b-aee7-98174925e3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16eda7a6-3fc2-4f54-b290-d040fdc5cd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16eda7a6-3fc2-4f54-b290-d040fdc5cd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1334584877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467aefc3-a7f3-4564-8e11-9684cc96cad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e85bbb91fe1d4114888bb9158a4fbabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:43Z,use_quota=True,user_id='5d638da0d42245c8b0f3ad623db1be85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a686ee86-aa7b-4a1c-b41c-0c9263c21ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a686ee86-aa7b-4a1c-b41c-0c9263c21ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7158af7d-e859-42b1-a776-23cee7425abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7158af7d-e859-42b1-a776-23cee7425abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467aefc3-a7f3-4564-8e11-9684cc96cad1', 'volume_name': 'volume-467aefc3-a7f3-4564-8e11-9684cc96cad1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16926ba-87ef-42d7-9916-c37b5c6669ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16926ba-87ef-42d7-9916-c37b5c6669ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a5845f-63b4-4e0c-89d6-8491f890d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:43 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Volume 467aefc3-a7f3-4564-8e11-9684cc96cad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467aefc3-a7f3-4564-8e11-9684cc96cad1', 'volume_size': 1} Jul 07 22:35:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:44 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f 1073741824" returned: 0 in 1.382s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:45 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f Jul 07 22:35:45 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:45 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f" returned: 0 in 0.798s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1334584877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467aefc3-a7f3-4564-8e11-9684cc96cad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e85bbb91fe1d4114888bb9158a4fbabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:43Z,use_quota=True,user_id='5d638da0d42245c8b0f3ad623db1be85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Creating volume 467aefc3-a7f3-4564-8e11-9684cc96cad1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:45 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a763eff6-5dd1-414e-b563-5a9e2eb12c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9542c909-66d0-43a1-a58d-9f968411d18f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:45 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 1073741824 Jul 07 22:35:45 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3f1568-75ac-4a13-82fe-74ef2469e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:45 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Volume volume-9542c909-66d0-43a1-a58d-9f968411d18f (9542c909-66d0-43a1-a58d-9f968411d18f): created successfully Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3f1568-75ac-4a13-82fe-74ef2469e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Flow 'volume_create_manager' (549dfb48-af29-4e7e-936d-36e21b3b5c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-34062ecc-7a58-4c5f-b1de-d4d96791b24c tempest-VolumesActionsTest-1337520735 None] Created volume successfully. Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Flow 'volume_create_manager' (88a9d87b-1835-44ff-ba9b-b883f6609d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa73813-372f-45df-ad93-e7f41f0cd3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa73813-372f-45df-ad93-e7f41f0cd3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-243290693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b5cb0e-1185-4aac-b238-3af7bca86463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921c071e2a094d359d4f6ef3a7fcaf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:47Z,use_quota=True,user_id='dad5b91c549e4fe7a8af614cc9073298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09515b0e-7431-4da5-8736-546a96202b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09515b0e-7431-4da5-8736-546a96202b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdac594-a9b9-4b7f-b98a-a4f32603c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdac594-a9b9-4b7f-b98a-a4f32603c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b5cb0e-1185-4aac-b238-3af7bca86463', 'volume_name': 'volume-26b5cb0e-1185-4aac-b238-3af7bca86463', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addabdd0-41a3-424e-8212-51d7318e355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addabdd0-41a3-424e-8212-51d7318e355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc42c59-ded5-47c9-9893-ddc6a6d3cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:46 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Volume 26b5cb0e-1185-4aac-b238-3af7bca86463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b5cb0e-1185-4aac-b238-3af7bca86463', 'volume_size': 1} Jul 07 22:35:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:47 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 1073741824" returned: 0 in 1.495s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:47 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 Jul 07 22:35:47 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "cinder-9542c909-66d0-43a1-a58d-9f968411d18f-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-9542c909-66d0-43a1-a58d-9f968411d18f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "cinder-quobyte-9542c909-66d0-43a1-a58d-9f968411d18f" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-quobyte-9542c909-66d0-43a1-a58d-9f968411d18f" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6d0060-3ead-4058-a009-cf59a7959017]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:48 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f Jul 07 22:35:48 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:48 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1" returned: 0 in 1.011s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] <== create_volume: return (2592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.597s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-243290693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b5cb0e-1185-4aac-b238-3af7bca86463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921c071e2a094d359d4f6ef3a7fcaf03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:47Z,use_quota=True,user_id='dad5b91c549e4fe7a8af614cc9073298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Creating volume 26b5cb0e-1185-4aac-b238-3af7bca86463 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:48 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a5845f-63b4-4e0c-89d6-8491f890d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467aefc3-a7f3-4564-8e11-9684cc96cad1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adf1429-8065-4a13-a141-f18144c2c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:48 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 1073741824 Jul 07 22:35:48 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:48 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Volume volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 (467aefc3-a7f3-4564-8e11-9684cc96cad1): created successfully Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adf1429-8065-4a13-a141-f18144c2c60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Flow 'volume_create_manager' (06e5aacf-d965-405b-aee7-98174925e3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-755c57c1-6d5b-469d-ba17-86c947e40a3f tempest-VolumesListTestJSON-1377236791 None] Created volume successfully. Jul 07 22:35:49 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f" returned: 0 in 1.255s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:49 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f Jul 07 22:35:49 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:49 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 1073741824" returned: 0 in 1.432s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:49 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 Jul 07 22:35:49 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9542c909-66d0-43a1-a58d-9f968411d18f" returned: 0 in 1.017s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:50 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-quobyte-9542c909-66d0-43a1-a58d-9f968411d18f" released by "delete_volume" :: held 2.359s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Created reservations ['af90c387-5798-49e0-b405-99b4c7e82165', 'ec3124cf-730e-4b13-8d6d-94bbe5ae6775', '2f1bcc50-601f-416c-acde-a11ba57d98e3', '77ecf89a-81e2-4fbd-8e48-17ac09fbdbda'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Flow 'volume_create_manager' (84573320-6ba6-4854-b486-5745dab17ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb30ccfa-5628-43ea-a940-2d070c09f55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb30ccfa-5628-43ea-a940-2d070c09f55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1903385429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8576631d-bb4f-435d-b286-5f87d9e12155,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e85bbb91fe1d4114888bb9158a4fbabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:51Z,use_quota=True,user_id='5d638da0d42245c8b0f3ad623db1be85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792fb325-02cf-4d9d-953f-2b26fb38b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792fb325-02cf-4d9d-953f-2b26fb38b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303cd6ff-2ef2-4567-9e00-772cbe4a4b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303cd6ff-2ef2-4567-9e00-772cbe4a4b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8576631d-bb4f-435d-b286-5f87d9e12155', 'volume_name': 'volume-8576631d-bb4f-435d-b286-5f87d9e12155', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c396fc6-33ec-4e7c-bb9d-9d265878d40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c396fc6-33ec-4e7c-bb9d-9d265878d40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8277a26d-64c5-44f6-86f9-d9ada02fcebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:50 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Volume 8576631d-bb4f-435d-b286-5f87d9e12155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8576631d-bb4f-435d-b286-5f87d9e12155', 'volume_size': 1} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:50 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:50 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:51 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463" returned: 0 in 1.200s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] <== create_volume: return (2707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.715s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1903385429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8576631d-bb4f-435d-b286-5f87d9e12155,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e85bbb91fe1d4114888bb9158a4fbabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:51Z,use_quota=True,user_id='5d638da0d42245c8b0f3ad623db1be85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Creating volume 8576631d-bb4f-435d-b286-5f87d9e12155 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:35:51 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc42c59-ded5-47c9-9893-ddc6a6d3cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b5cb0e-1185-4aac-b238-3af7bca86463', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:51 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 1073741824 Jul 07 22:35:51 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ef23cd-db07-489d-912d-076c08c9d7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:51 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Volume volume-26b5cb0e-1185-4aac-b238-3af7bca86463 (26b5cb0e-1185-4aac-b238-3af7bca86463): created successfully Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ef23cd-db07-489d-912d-076c08c9d7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Flow 'volume_create_manager' (88a9d87b-1835-44ff-ba9b-b883f6609d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:51 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7416fffa-620c-474b-a53e-b6f55dc64da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Created volume successfully. Jul 07 22:35:51 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.045s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:51 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Deleted volume successfully. Jul 07 22:35:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69242081-388a-4626-b96e-4532c77b8012 tempest-VolumesActionsTest-1337520735 None] Lock "cinder-9542c909-66d0-43a1-a58d-9f968411d18f-delete_volume" released by "delete_volume" :: held 3.974s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:35:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:52 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 1073741824" returned: 0 in 1.643s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:52 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 Jul 07 22:35:52 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:53 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155" returned: 0 in 0.806s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] <== create_volume: return (2507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.511s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.279s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Creating offline snapshot 6d68dc5f-4649-4042-8232-fc3f86c1de12 of volume 26b5cb0e-1185-4aac-b238-3af7bca86463 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8277a26d-64c5-44f6-86f9-d9ada02fcebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8576631d-bb4f-435d-b286-5f87d9e12155', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca7ade1-bf17-4d6d-89ca-41b9a2d3c3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b45ffe8-3c2a-4326-8ad2-ffbb80f4ab68]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:53 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Volume volume-8576631d-bb4f-435d-b286-5f87d9e12155 (8576631d-bb4f-435d-b286-5f87d9e12155): created successfully Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca7ade1-bf17-4d6d-89ca-41b9a2d3c3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:35:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Flow 'volume_create_manager' (84573320-6ba6-4854-b486-5745dab17ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:35:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-51869b00-2b02-4e90-9118-1e439af58324 tempest-VolumesListTestJSON-1377236791 None] Created volume successfully. Jul 07 22:35:53 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 Jul 07 22:35:53 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:54 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463" returned: 0 in 1.139s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:54 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 1G Jul 07 22:35:54 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:35:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:35:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:35:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:35:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:35:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:35:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:55 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:35:55 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:56 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 1G" returned: 0 in 1.394s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b5cb0e-1185-4aac-b238-3af7bca86463 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:56 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b5cb0e-1185-4aac-b238-3af7bca86463 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 Jul 07 22:35:56 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:57 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.411s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:35:57 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:35:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:35:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:35:57 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b5cb0e-1185-4aac-b238-3af7bca86463 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12" returned: 0 in 1.339s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:57 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 is being set with open permissions: ugo+rw Jul 07 22:35:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:57 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 Jul 07 22:35:57 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:58 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 07 22:35:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12" returned: 0 in 1.136s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:35:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:58 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.info Jul 07 22:35:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "cinder-8576631d-bb4f-435d-b286-5f87d9e12155-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:58 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:35:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-8576631d-bb4f-435d-b286-5f87d9e12155-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "cinder-quobyte-8576631d-bb4f-435d-b286-5f87d9e12155" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:35:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-quobyte-8576631d-bb4f-435d-b286-5f87d9e12155" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:35:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[37095d20-8d84-4bb1-8095-dbdecd2e0126]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:35:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:35:59 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 Jul 07 22:35:59 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:00 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.info" returned: 0 in 1.206s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:00 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.info is being set with open permissions: ugo+rw Jul 07 22:36:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:00 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.info Jul 07 22:36:00 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:00 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155" returned: 0 in 1.125s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:00 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155 Jul 07 22:36:00 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:01 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.info" returned: 0 in 1.084s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.524s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:01 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-8576631d-bb4f-435d-b286-5f87d9e12155" returned: 0 in 0.991s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-quobyte-8576631d-bb4f-435d-b286-5f87d9e12155" released by "delete_volume" :: held 2.198s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:01 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-76d7339b-ff34-41c8-ad5e-81574d9202cf tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Create snapshot completed successfully Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Created reservations ['bbf565c7-7427-487b-8f44-b44f5120fd5c', 'def56afe-8519-4b42-acd0-c72a92babe60', 'b401e850-515c-42aa-9b91-98500e23029f', 'cb161b7d-bbe0-44b9-b3ac-5bdf8f79cd8f'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:01 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:01 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:02 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.858s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Deleted volume successfully. Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ca7f133b-cf77-43b9-aef1-07a8ae54da99 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-8576631d-bb4f-435d-b286-5f87d9e12155-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "cinder-467aefc3-a7f3-4564-8e11-9684cc96cad1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-467aefc3-a7f3-4564-8e11-9684cc96cad1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "cinder-quobyte-467aefc3-a7f3-4564-8e11-9684cc96cad1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-quobyte-467aefc3-a7f3-4564-8e11-9684cc96cad1" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[27052022-6003-4de1-a4cc-2560fd603167]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:03 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 Jul 07 22:36:03 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "cinder-6d68dc5f-4649-4042-8232-fc3f86c1de12-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-6d68dc5f-4649-4042-8232-fc3f86c1de12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "cinder-quobyte-26b5cb0e-1185-4aac-b238-3af7bca86463" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-quobyte-26b5cb0e-1185-4aac-b238-3af7bca86463" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "cinder-quobyte-6d68dc5f-4649-4042-8232-fc3f86c1de12" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-quobyte-6d68dc5f-4649-4042-8232-fc3f86c1de12" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Deleting offline snapshot 6d68dc5f-4649-4042-8232-fc3f86c1de12 of volume 26b5cb0e-1185-4aac-b238-3af7bca86463 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] snapshot_file for this snap is: volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef7a3c-2c53-4f7f-aa31-876ddce9b574]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:03 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 Jul 07 22:36:03 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:04 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1" returned: 0 in 1.376s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:04 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1 Jul 07 22:36:04 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:04 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12" returned: 0 in 1.453s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26b5cb0e-1185-4aac-b238-3af7bca86463(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:36:04 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b262fe6c-cc07-4e44-8a0f-994fd29616f1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:04 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 Jul 07 22:36:04 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:05 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-467aefc3-a7f3-4564-8e11-9684cc96cad1" returned: 0 in 1.121s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-quobyte-467aefc3-a7f3-4564-8e11-9684cc96cad1" released by "delete_volume" :: held 2.595s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Created reservations ['aceb4e31-b5ca-42f1-b0e1-1296a22018c7', 'ee860163-2e24-42df-ba49-4b55da9724dc', '5fb27329-9d00-40c1-ba0f-072126f07841', '52c1b6fb-c526-4ffe-ae6d-0112d3c94ce9'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=105,cinder:INSERT=37,cinder:UPDATE=136,cinder:DELETE=14 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:05 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:05 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:05 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463" returned: 0 in 1.294s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:06 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 Jul 07 22:36:06 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "cinder-6a18fe5a-d309-4552-bf88-486121f8cd9f-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-6a18fe5a-d309-4552-bf88-486121f8cd9f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "cinder-quobyte-6a18fe5a-d309-4552-bf88-486121f8cd9f" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-quobyte-6a18fe5a-d309-4552-bf88-486121f8cd9f" acquired by "delete_volume" :: waited 0.043s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ed0654-77af-4707-9512-4201599e1e0d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:06 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f Jul 07 22:36:06 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:06 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.995s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:06 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Deleted volume successfully. Jul 07 22:36:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f610f703-6d21-42f9-a55a-a1dec368a556 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-467aefc3-a7f3-4564-8e11-9684cc96cad1-delete_volume" released by "delete_volume" :: held 4.074s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:07 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12" returned: 0 in 1.605s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:07 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f" returned: 0 in 1.220s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:07 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12 Jul 07 22:36:07 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:07 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f Jul 07 22:36:07 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:08 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463.6d68dc5f-4649-4042-8232-fc3f86c1de12" returned: 0 in 1.075s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:08 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6a18fe5a-d309-4552-bf88-486121f8cd9f" returned: 0 in 1.072s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-quobyte-6a18fe5a-d309-4552-bf88-486121f8cd9f" released by "delete_volume" :: held 2.439s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-quobyte-6d68dc5f-4649-4042-8232-fc3f86c1de12" released by "_delete_snapshot" :: held 5.680s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-quobyte-26b5cb0e-1185-4aac-b238-3af7bca86463" released by "delete_snapshot" :: held 5.718s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:08 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Created reservations ['b7524273-d0f3-43e1-ac50-d3cc40785565', '3d36c01f-d028-4ac2-a1cf-61b65ada29c6', '879ce4a3-2af6-49d6-ac37-6982196623ff', 'd359b6c4-1b80-450d-9b7c-9b9316934dab'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:08 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Created reservations ['095740c0-635d-421f-813e-9d15e3906976', '6854dbf2-5554-43ff-ac9d-de882ee5d44b', 'b037fef0-3966-4327-b3f9-44b69a6e91ba', 'f48190f4-c9e4-449a-9d5c-82d517702fab'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:09 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:09 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:09 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Delete snapshot completed successfully. Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9069ec27-2878-409e-8f63-0e563e649830 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-6d68dc5f-4649-4042-8232-fc3f86c1de12-delete_snapshot" released by "delete_snapshot" :: held 6.076s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "cinder-26b5cb0e-1185-4aac-b238-3af7bca86463-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-26b5cb0e-1185-4aac-b238-3af7bca86463-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "cinder-quobyte-26b5cb0e-1185-4aac-b238-3af7bca86463" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-quobyte-26b5cb0e-1185-4aac-b238-3af7bca86463" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[39484aab-38ae-4980-b101-d27c2fc38e08]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:10 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 Jul 07 22:36:10 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:10 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.213s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:10 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:10 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Deleted volume successfully. Jul 07 22:36:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-26fa4d83-e4f1-4113-bdc0-ae5a38e27eb3 tempest-VolumesListTestJSON-1377236791 None] Lock "cinder-6a18fe5a-d309-4552-bf88-486121f8cd9f-delete_volume" released by "delete_volume" :: held 4.136s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:11 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463" returned: 0 in 1.270s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:11 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463 Jul 07 22:36:11 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:12 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-26b5cb0e-1185-4aac-b238-3af7bca86463" returned: 0 in 0.811s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-quobyte-26b5cb0e-1185-4aac-b238-3af7bca86463" released by "delete_volume" :: held 2.210s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Created reservations ['08ff524c-217a-4ec5-9e2f-5b43a570c05f', 'e6ea95b7-bfc1-4ffd-9219-e4aa9843d071', 'aac9c2d2-feef-43da-935f-9db46b1045bd', 'a9790f92-55b4-4d1f-b544-e9ac3f5952b5'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:12 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:12 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Flow 'volume_create_manager' (01ff9336-220e-4a7d-9a0e-51266daba896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b543e9f5-e08e-45e2-8599-4e14ac09e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b543e9f5-e08e-45e2-8599-4e14ac09e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-909528909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6225b36f-ce4e-439d-9d40-9cde47db6ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ffd35556e04adfb8ad13052b0409a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:13Z,use_quota=True,user_id='127d72c935f241e5a785b0e34100849b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54fd547-ab67-4727-82b7-250380a28f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54fd547-ab67-4727-82b7-250380a28f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d157f99a-d40c-448f-95a9-b22037b2bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d157f99a-d40c-448f-95a9-b22037b2bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6225b36f-ce4e-439d-9d40-9cde47db6ed1', 'volume_name': 'volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3f9945-1764-41e2-9482-92fda9893b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3f9945-1764-41e2-9482-92fda9893b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f486ea-218a-4e89-abf9-1970687e2352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:12 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Volume 6225b36f-ce4e-439d-9d40-9cde47db6ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1', 'volume_size': 1} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-909528909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6225b36f-ce4e-439d-9d40-9cde47db6ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ffd35556e04adfb8ad13052b0409a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:13Z,use_quota=True,user_id='127d72c935f241e5a785b0e34100849b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Creating volume 6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:12 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:36:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:12 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 1073741824 Jul 07 22:36:12 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:13 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.235s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:13 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Deleted volume successfully. Jul 07 22:36:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f191ea8a-ca5e-416c-b336-4060e5bd5ca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2093455103 None] Lock "cinder-26b5cb0e-1185-4aac-b238-3af7bca86463-delete_volume" released by "delete_volume" :: held 3.878s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:14 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 1073741824" returned: 0 in 1.284s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:14 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 Jul 07 22:36:14 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:15 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1" returned: 0 in 0.942s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f486ea-218a-4e89-abf9-1970687e2352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97052dc-578e-4895-baa0-766dbbdc78e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Volume volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 (6225b36f-ce4e-439d-9d40-9cde47db6ed1): created successfully Jul 07 22:36:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97052dc-578e-4895-baa0-766dbbdc78e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Flow 'volume_create_manager' (01ff9336-220e-4a7d-9a0e-51266daba896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a3451beb-3a45-4a20-83af-ca2feae5ac80 tempest-TestStampPattern-767674385 None] Created volume successfully. Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Flow 'volume_create_manager' (98d2f775-e771-43ad-8da9-4274a459fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3679159d-fce0-41b2-ae4e-8d8af21786c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3679159d-fce0-41b2-ae4e-8d8af21786c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1307455552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bcc580-7d89-4df9-b57f-36048d017552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a19e2780814ef3bdf46ca1a689ae07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:17Z,use_quota=True,user_id='d5745308a6f34fc58943bb8655256568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c285929-246d-4622-abc1-22f1d402df12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c285929-246d-4622-abc1-22f1d402df12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80773b71-0c0a-426e-b40e-281a064f7988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80773b71-0c0a-426e-b40e-281a064f7988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37bcc580-7d89-4df9-b57f-36048d017552', 'volume_name': 'volume-37bcc580-7d89-4df9-b57f-36048d017552', 'volume_size': 2}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee46b37-21a2-4efb-bccb-f6760547db13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee46b37-21a2-4efb-bccb-f6760547db13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75b126b-fd80-4fb3-8487-19766dace6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:16 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Volume 37bcc580-7d89-4df9-b57f-36048d017552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37bcc580-7d89-4df9-b57f-36048d017552', 'volume_size': 2} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1307455552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bcc580-7d89-4df9-b57f-36048d017552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a19e2780814ef3bdf46ca1a689ae07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:17Z,use_quota=True,user_id='d5745308a6f34fc58943bb8655256568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Creating volume 37bcc580-7d89-4df9-b57f-36048d017552 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:17 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:36:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 2147483648 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:17 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 2147483648 Jul 07 22:36:17 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:18 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 2147483648" returned: 0 in 1.348s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:18 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 Jul 07 22:36:18 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Flow 'volume_create_manager' (b9ca8a6e-76e0-4c05-90c9-e0e5080c675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef554dca-8177-423c-ba2f-cb8bfe1708ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef554dca-8177-423c-ba2f-cb8bfe1708ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2026948217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df90e38-e00a-447a-806a-0cf5e244a4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fa6ab6e19f4c3e98750fdc088554c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:19Z,use_quota=True,user_id='4dd373c9cb8c4f54a5504cfffc66a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27b680f-47b2-4cea-9050-3ddba074e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27b680f-47b2-4cea-9050-3ddba074e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8b1ad4-2250-4bbe-baaf-fab47cdbc5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8b1ad4-2250-4bbe-baaf-fab47cdbc5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df90e38-e00a-447a-806a-0cf5e244a4e4', 'volume_name': 'volume-4df90e38-e00a-447a-806a-0cf5e244a4e4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71941efb-a218-433c-b30b-2ed8f5b7752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71941efb-a218-433c-b30b-2ed8f5b7752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc81ab2-f195-43ab-92a4-c7bc69c8ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:18 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Volume 4df90e38-e00a-447a-806a-0cf5e244a4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df90e38-e00a-447a-806a-0cf5e244a4e4', 'volume_size': 1} Jul 07 22:36:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:19 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552" returned: 0 in 0.908s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.339s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2026948217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df90e38-e00a-447a-806a-0cf5e244a4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fa6ab6e19f4c3e98750fdc088554c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:19Z,use_quota=True,user_id='4dd373c9cb8c4f54a5504cfffc66a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Creating volume 4df90e38-e00a-447a-806a-0cf5e244a4e4 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:19 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:19 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 1073741824 Jul 07 22:36:19 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75b126b-fd80-4fb3-8487-19766dace6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37bcc580-7d89-4df9-b57f-36048d017552', 'volume_size': 2}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a569c2-5d0b-4b3d-9531-b5e05607bd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:19 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Volume volume-37bcc580-7d89-4df9-b57f-36048d017552 (37bcc580-7d89-4df9-b57f-36048d017552): created successfully Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a569c2-5d0b-4b3d-9531-b5e05607bd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Flow 'volume_create_manager' (98d2f775-e771-43ad-8da9-4274a459fda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8859087f-91dc-4da9-b974-40925d602a31 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Created volume successfully. Jul 07 22:36:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:20 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 1073741824" returned: 0 in 1.450s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:20 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 Jul 07 22:36:20 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:21 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4" returned: 0 in 1.138s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] <== create_volume: return (2643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.648s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.423s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc81ab2-f195-43ab-92a4-c7bc69c8ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df90e38-e00a-447a-806a-0cf5e244a4e4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b93767b-eb48-4759-8835-a89e92d3a836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Creating offline snapshot fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 of volume 37bcc580-7d89-4df9-b57f-36048d017552 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:36:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Volume volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 (4df90e38-e00a-447a-806a-0cf5e244a4e4): created successfully Jul 07 22:36:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b93767b-eb48-4759-8835-a89e92d3a836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Flow 'volume_create_manager' (b9ca8a6e-76e0-4c05-90c9-e0e5080c675e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:22 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b030f-b53a-4dff-8238-2541a92fe9c6]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-18d03e00-3df4-42a0-8513-50dc524e82fd tempest-VolumesTransfersTest-1042958640 None] Created volume successfully. Jul 07 22:36:22 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 Jul 07 22:36:22 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:23 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552" returned: 0 in 1.125s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 2G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:23 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 2G Jul 07 22:36:23 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Flow 'volume_create_manager' (5a160cf2-8cd0-4475-a2b9-4493092bf667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508649bb-ebfa-4d6a-8f1d-b5b8514484e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508649bb-ebfa-4d6a-8f1d-b5b8514484e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-98174156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4c693c-d305-4398-ab2f-4b4c1de4cc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0711777b207428e863a77ba864d3f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:24Z,use_quota=True,user_id='41bbf8540f7f4a61b2c9a15e162c52cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ef21a3-54b3-4a0e-a9e5-cd97ba6ed537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ef21a3-54b3-4a0e-a9e5-cd97ba6ed537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a321a0ff-17ec-4993-b48d-8820b6430a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a321a0ff-17ec-4993-b48d-8820b6430a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4c693c-d305-4398-ab2f-4b4c1de4cc4a', 'volume_name': 'volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7c0127-7f6f-4976-8004-f57b6957bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7c0127-7f6f-4976-8004-f57b6957bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a0f3e7-33bf-481f-9f58-9511433ed316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:24 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Volume ba4c693c-d305-4398-ab2f-4b4c1de4cc4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a', 'volume_size': 1} Jul 07 22:36:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c549e513-5686-4e06-b157-963f7a4bc94d tempest-VolumesTransfersTest-938616692 None] Transfer volume completed successfully. Jul 07 22:36:24 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 2G" returned: 0 in 1.183s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37bcc580-7d89-4df9-b57f-36048d017552 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:24 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37bcc580-7d89-4df9-b57f-36048d017552 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 Jul 07 22:36:24 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:25 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37bcc580-7d89-4df9-b57f-36048d017552 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1" returned: 0 in 0.862s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:25 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 is being set with open permissions: ugo+rw Jul 07 22:36:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:25 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 Jul 07 22:36:25 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Acquiring lock "cinder-4df90e38-e00a-447a-806a-0cf5e244a4e4-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Lock "cinder-4df90e38-e00a-447a-806a-0cf5e244a4e4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Acquiring lock "cinder-quobyte-4df90e38-e00a-447a-806a-0cf5e244a4e4" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Lock "cinder-quobyte-4df90e38-e00a-447a-806a-0cf5e244a4e4" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:25 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a33683-4af1-45fe-8ccf-aa7f7905f5f5]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:25 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 Jul 07 22:36:25 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:26 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1" returned: 0 in 0.886s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:26 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.info Jul 07 22:36:26 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:26 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4" returned: 0 in 0.956s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:26 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4 Jul 07 22:36:26 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:27 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.info" returned: 0 in 1.014s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:27 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.info is being set with open permissions: ugo+rw Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:27 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.info Jul 07 22:36:27 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:27 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-4df90e38-e00a-447a-806a-0cf5e244a4e4" returned: 0 in 0.990s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Lock "cinder-quobyte-4df90e38-e00a-447a-806a-0cf5e244a4e4" released by "delete_volume" :: held 2.008s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Created reservations ['c874eaa2-1661-42d8-9d30-3b54c630f454', '9e53aa61-adf3-49a3-accc-bf25ded6a568', '664c6660-1816-42e1-a543-d3efa4dfabfd', '33661b55-9493-42ca-b5f4-76de86469606'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:27 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:27 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:28 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.info" returned: 0 in 0.923s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.180s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.156s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-98174156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4c693c-d305-4398-ab2f-4b4c1de4cc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0711777b207428e863a77ba864d3f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:24Z,use_quota=True,user_id='41bbf8540f7f4a61b2c9a15e162c52cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Creating volume ba4c693c-d305-4398-ab2f-4b4c1de4cc4a {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:28 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:28 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a 1073741824 Jul 07 22:36:28 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-597fc736-f24c-44e3-9e13-024563d8f222 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Create snapshot completed successfully Jul 07 22:36:28 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.903s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Deleted volume successfully. Jul 07 22:36:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dc340493-4072-49e0-bd68-c01141c88a3a tempest-VolumesTransfersTest-1738976100 None] Lock "cinder-4df90e38-e00a-447a-806a-0cf5e244a4e4-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "cinder-fe556cc3-f5bf-4177-ba0d-93c63c60ccb1-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-fe556cc3-f5bf-4177-ba0d-93c63c60ccb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "cinder-quobyte-37bcc580-7d89-4df9-b57f-36048d017552" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-quobyte-37bcc580-7d89-4df9-b57f-36048d017552" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "cinder-quobyte-fe556cc3-f5bf-4177-ba0d-93c63c60ccb1" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-quobyte-fe556cc3-f5bf-4177-ba0d-93c63c60ccb1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Deleting offline snapshot fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 of volume 37bcc580-7d89-4df9-b57f-36048d017552 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] snapshot_file for this snap is: volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f3dc67-9fc3-40d4-8994-62858f231632]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:29 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a 1073741824" returned: 0 in 1.298s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:29 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a Jul 07 22:36:29 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:29 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 Jul 07 22:36:29 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Flow 'volume_create_manager' (a5d8e7a5-6dcc-4ae9-a8a8-dd80614fdb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff4da99-0673-465d-bf22-c8789bd93735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff4da99-0673-465d-bf22-c8789bd93735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-222365311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f91a7b0-cb52-43df-933f-7bfd85d2480b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fa6ab6e19f4c3e98750fdc088554c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:30Z,use_quota=True,user_id='4dd373c9cb8c4f54a5504cfffc66a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6255e76-f75d-4bf7-ba54-8a2a3e450850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6255e76-f75d-4bf7-ba54-8a2a3e450850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e22d3a-76f5-4b0e-a972-2bab65fe9c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e22d3a-76f5-4b0e-a972-2bab65fe9c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f91a7b0-cb52-43df-933f-7bfd85d2480b', 'volume_name': 'volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc0ff30-5d0b-4ce6-9670-855534172b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc0ff30-5d0b-4ce6-9670-855534172b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56d47a3-3aa8-4504-a532-5ba049954d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:29 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Volume 7f91a7b0-cb52-43df-933f-7bfd85d2480b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b', 'volume_size': 1} Jul 07 22:36:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:30 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1" returned: 0 in 1.066s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37bcc580-7d89-4df9-b57f-36048d017552(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:36:30 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a" returned: 0 in 0.979s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] <== create_volume: return (2392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.399s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-222365311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f91a7b0-cb52-43df-933f-7bfd85d2480b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fa6ab6e19f4c3e98750fdc088554c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:30Z,use_quota=True,user_id='4dd373c9cb8c4f54a5504cfffc66a387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Creating volume 7f91a7b0-cb52-43df-933f-7bfd85d2480b {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:30 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4d2cc-5c93-4ab8-a9b1-ef31785086d2]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:30 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b 1073741824 Jul 07 22:36:30 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a0f3e7-33bf-481f-9f58-9511433ed316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f628a6-90f6-40b0-9e60-ff8d3038adf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Volume volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a (ba4c693c-d305-4398-ab2f-4b4c1de4cc4a): created successfully Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f628a6-90f6-40b0-9e60-ff8d3038adf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Flow 'volume_create_manager' (5a160cf2-8cd0-4475-a2b9-4493092bf667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f75a4b48-1889-4d9f-a8b0-3353e8761c3a tempest-VolumesTransfersV355Test-1279769961 None] Created volume successfully. Jul 07 22:36:30 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 Jul 07 22:36:30 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:31 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b 1073741824" returned: 0 in 1.329s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:31 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552" returned: 0 in 1.348s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:32 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 Jul 07 22:36:32 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:32 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b Jul 07 22:36:32 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-faf78f5d-9fc4-463c-a48b-072cdc68b7b0 tempest-VolumesTransfersV355Test-1412308991 None] Transfer volume completed successfully. Jul 07 22:36:33 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b" returned: 0 in 1.294s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] <== create_volume: return (2742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.748s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56d47a3-3aa8-4504-a532-5ba049954d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73672025-2878-47b3-93c8-39cc478faab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:33 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Volume volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b (7f91a7b0-cb52-43df-933f-7bfd85d2480b): created successfully Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73672025-2878-47b3-93c8-39cc478faab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Flow 'volume_create_manager' (a5d8e7a5-6dcc-4ae9-a8a8-dd80614fdb21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-eb8ac281-aca6-4638-a2e1-5b7a58a2dc49 tempest-VolumesTransfersTest-1042958640 None] Created volume successfully. Jul 07 22:36:33 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1" returned: 0 in 1.467s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:33 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1 Jul 07 22:36:33 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:34 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552.fe556cc3-f5bf-4177-ba0d-93c63c60ccb1" returned: 0 in 0.854s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Acquiring lock "cinder-7f91a7b0-cb52-43df-933f-7bfd85d2480b-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Lock "cinder-7f91a7b0-cb52-43df-933f-7bfd85d2480b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-quobyte-fe556cc3-f5bf-4177-ba0d-93c63c60ccb1" released by "_delete_snapshot" :: held 5.021s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-quobyte-37bcc580-7d89-4df9-b57f-36048d017552" released by "delete_snapshot" :: held 5.072s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Acquiring lock "cinder-quobyte-7f91a7b0-cb52-43df-933f-7bfd85d2480b" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Acquiring lock "cinder-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Lock "cinder-quobyte-7f91a7b0-cb52-43df-933f-7bfd85d2480b" acquired by "delete_volume" :: waited 0.051s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Lock "cinder-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2148f41-dcb5-47ae-96e5-8fbd5a16f09d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Acquiring lock "cinder-quobyte-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Created reservations ['494c7bba-32b9-4c3c-80e1-8c42e0d5e132', '43069096-a40d-409d-afe5-304115d274c6', '7e250cb7-0f9e-4e91-9238-734392d90143', 'c5b8f5b5-98e1-407a-a4bd-053353963d5e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Lock "cinder-quobyte-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a" acquired by "delete_volume" :: waited 0.049s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[414a640e-a3f8-40ae-bf45-c6438eaf3961]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:34 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b Jul 07 22:36:34 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Delete snapshot completed successfully. Jul 07 22:36:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7ccd1d7-1494-42d7-b868-931f6940ab0e tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-fe556cc3-f5bf-4177-ba0d-93c63c60ccb1-delete_snapshot" released by "delete_snapshot" :: held 5.531s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:34 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a Jul 07 22:36:34 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:35 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b" returned: 0 in 1.121s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:35 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b Jul 07 22:36:35 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:35 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a" returned: 0 in 1.124s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:35 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a Jul 07 22:36:35 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "cinder-37bcc580-7d89-4df9-b57f-36048d017552-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-37bcc580-7d89-4df9-b57f-36048d017552-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "cinder-quobyte-37bcc580-7d89-4df9-b57f-36048d017552" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-quobyte-37bcc580-7d89-4df9-b57f-36048d017552" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0e00fb-c622-4b69-84ef-5fecd2ae7e7a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:36 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 Jul 07 22:36:36 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:36 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7f91a7b0-cb52-43df-933f-7bfd85d2480b" returned: 0 in 1.274s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Lock "cinder-quobyte-7f91a7b0-cb52-43df-933f-7bfd85d2480b" released by "delete_volume" :: held 2.478s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Created reservations ['354abc0e-0de3-4310-945d-1fd4a4599e5c', 'e040ae08-234e-4f02-84a1-71c5d25222f1', '1b66a3e3-891a-45ff-9e08-a68a6bac48f7', '99a585f3-c0db-41fd-80bf-604302002f14'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:37 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:37 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:37 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a" returned: 0 in 1.635s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Lock "cinder-quobyte-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a" released by "delete_volume" :: held 2.843s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:37 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552" returned: 0 in 1.399s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:37 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552 Jul 07 22:36:37 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Created reservations ['811f31c6-2bd0-4cdf-afcf-5176418e5e6f', '1a6e7330-cc8e-4a7e-9d95-29745f562d15', '008b502d-d634-451d-a504-aa5f85914824', 'e609ec8b-bd24-4c10-901c-c93bdc6d4d06'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:38 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:38 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:39 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.271s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Deleted volume successfully. Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=91,cinder:UPDATE=127,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-31645b13-0607-476f-9c0d-c80925c3e1c2 tempest-VolumesTransfersV355Test-197732445 None] Lock "cinder-ba4c693c-d305-4398-ab2f-4b4c1de4cc4a-delete_volume" released by "delete_volume" :: held 4.780s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Flow 'volume_create_manager' (e03ab380-d9a8-41f5-9c4c-6a9326956501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20be2198-5071-4670-a270-8960c4046ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20be2198-5071-4670-a270-8960c4046ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1381809945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746b85d6-1d58-480c-a0a1-49fb6651d19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0711777b207428e863a77ba864d3f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:39Z,use_quota=True,user_id='41bbf8540f7f4a61b2c9a15e162c52cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b69a42-0741-46d8-b973-3ff2280b9666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b69a42-0741-46d8-b973-3ff2280b9666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedbb873-d8ba-4faf-a6df-51dc7f541eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedbb873-d8ba-4faf-a6df-51dc7f541eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746b85d6-1d58-480c-a0a1-49fb6651d19a', 'volume_name': 'volume-746b85d6-1d58-480c-a0a1-49fb6651d19a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb16e3bc-0580-4bd6-91b8-8d5abe433bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb16e3bc-0580-4bd6-91b8-8d5abe433bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07c762c-0820-4432-9006-8455c5f3b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:39 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Volume 746b85d6-1d58-480c-a0a1-49fb6651d19a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746b85d6-1d58-480c-a0a1-49fb6651d19a', 'volume_size': 1} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1381809945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746b85d6-1d58-480c-a0a1-49fb6651d19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0711777b207428e863a77ba864d3f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:39Z,use_quota=True,user_id='41bbf8540f7f4a61b2c9a15e162c52cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Creating volume 746b85d6-1d58-480c-a0a1-49fb6651d19a {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:39 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:39 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 2.387s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Deleted volume successfully. Jul 07 22:36:39 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a 1073741824 Jul 07 22:36:39 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b801ca0a-16aa-47eb-ab84-eddd8b040816 tempest-VolumesTransfersTest-1738976100 None] Lock "cinder-7f91a7b0-cb52-43df-933f-7bfd85d2480b-delete_volume" released by "delete_volume" :: held 5.538s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:39 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37bcc580-7d89-4df9-b57f-36048d017552" returned: 0 in 2.351s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-quobyte-37bcc580-7d89-4df9-b57f-36048d017552" released by "delete_volume" :: held 3.876s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:40 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Created reservations ['51378d44-1b32-4108-a541-7380b30c5141', '9452ad45-a47f-4985-bf9d-7e98e2aedbfc', '0720f5f0-bb4b-4d3d-b356-cf07142b5377', '1e57db81-c551-4e3b-a8d3-fe63a212fd75'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:40 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:40 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:41 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.507s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:41 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Deleted volume successfully. Jul 07 22:36:41 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a 1073741824" returned: 0 in 2.066s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4d9a24fb-6465-43a0-9cfe-95631a177a03 tempest-VolumesSnapshotNegativeTestJSON-1702522238 None] Lock "cinder-37bcc580-7d89-4df9-b57f-36048d017552-delete_volume" released by "delete_volume" :: held 5.808s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:41 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a Jul 07 22:36:41 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:42 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a" returned: 0 in 1.011s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] <== create_volume: return (3164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.171s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07c762c-0820-4432-9006-8455c5f3b24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746b85d6-1d58-480c-a0a1-49fb6651d19a', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cf122f-115a-4372-af96-0cee587b1193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:43 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Volume volume-746b85d6-1d58-480c-a0a1-49fb6651d19a (746b85d6-1d58-480c-a0a1-49fb6651d19a): created successfully Jul 07 22:36:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cf122f-115a-4372-af96-0cee587b1193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Flow 'volume_create_manager' (e03ab380-d9a8-41f5-9c4c-6a9326956501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:43 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a76531c7-166a-4d6a-a1ef-d27a1379ca4b tempest-VolumesTransfersV355Test-1279769961 None] Created volume successfully. Jul 07 22:36:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Acquiring lock "cinder-746b85d6-1d58-480c-a0a1-49fb6651d19a-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Lock "cinder-746b85d6-1d58-480c-a0a1-49fb6651d19a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Acquiring lock "cinder-quobyte-746b85d6-1d58-480c-a0a1-49fb6651d19a" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Lock "cinder-quobyte-746b85d6-1d58-480c-a0a1-49fb6651d19a" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:44 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2313995f-d080-46cf-a79d-b892644234f7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:44 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a Jul 07 22:36:44 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:45 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a" returned: 0 in 0.977s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:45 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a Jul 07 22:36:45 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:46 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-746b85d6-1d58-480c-a0a1-49fb6651d19a" returned: 0 in 0.894s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Lock "cinder-quobyte-746b85d6-1d58-480c-a0a1-49fb6651d19a" released by "delete_volume" :: held 1.947s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Created reservations ['b0b588bb-5b7e-4f20-9411-6aea95f0ee1d', '5d342bcf-0d1b-4d98-b827-91ab9bb39f97', '82ec6e53-8b5e-4f70-b430-6a62d60c0d75', '075eb2f4-948b-4759-800c-4b291518fbde'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:46 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:46 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:47 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.222s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:47 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:47 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Deleted volume successfully. Jul 07 22:36:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7cd14f05-d04c-4f85-b004-ddff35ea880b tempest-VolumesTransfersV355Test-197732445 None] Lock "cinder-746b85d6-1d58-480c-a0a1-49fb6651d19a-delete_volume" released by "delete_volume" :: held 3.596s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Flow 'volume_create_manager' (348637c7-7feb-40b7-b646-2fda2923bf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1836e6f9-5137-4bb3-97d4-9a99df81c890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1836e6f9-5137-4bb3-97d4-9a99df81c890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1665139045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f3414a-3726-489c-85bd-97a71c9a744d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884031dadb514999969fa79e3b050fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:51Z,use_quota=True,user_id='6a05c3c823ad48d7bfa713a2bc74d5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3352c67b-c427-43d5-abe2-d603020efa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3352c67b-c427-43d5-abe2-d603020efa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2790b8ce-2c23-4559-abad-96cabdf881cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2790b8ce-2c23-4559-abad-96cabdf881cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f3414a-3726-489c-85bd-97a71c9a744d', 'volume_name': 'volume-27f3414a-3726-489c-85bd-97a71c9a744d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8091de1f-b673-4ec6-8794-aadb57e9f7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8091de1f-b673-4ec6-8794-aadb57e9f7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7e07c1-d4ad-44c1-9799-14c43eaed5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:51 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Volume 27f3414a-3726-489c-85bd-97a71c9a744d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f3414a-3726-489c-85bd-97a71c9a744d', 'volume_size': 1} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1665139045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f3414a-3726-489c-85bd-97a71c9a744d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884031dadb514999969fa79e3b050fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:51Z,use_quota=True,user_id='6a05c3c823ad48d7bfa713a2bc74d5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Creating volume 27f3414a-3726-489c-85bd-97a71c9a744d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:36:51 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:36:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:51 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d 1073741824 Jul 07 22:36:51 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:52 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d 1073741824" returned: 0 in 1.428s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:53 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d Jul 07 22:36:53 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:53 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d" returned: 0 in 0.981s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] <== create_volume: return (2480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:36:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7e07c1-d4ad-44c1-9799-14c43eaed5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f3414a-3726-489c-85bd-97a71c9a744d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf183c6-70ec-46da-ad9c-82609ad8c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:54 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Volume volume-27f3414a-3726-489c-85bd-97a71c9a744d (27f3414a-3726-489c-85bd-97a71c9a744d): created successfully Jul 07 22:36:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf183c6-70ec-46da-ad9c-82609ad8c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Flow 'volume_create_manager' (348637c7-7feb-40b7-b646-2fda2923bf5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:54 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-36fd8b90-d258-4467-b10b-1edb4f6bc2ac tempest-VolumesTransfersV357Test-1421245025 None] Created volume successfully. Jul 07 22:36:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:36:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:36:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:36:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:36:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:36:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:36:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:55 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:36:55 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-bf9f3f0c-a7c2-4595-a5b1-83599606eb08 tempest-VolumesTransfersV357Test-1700842494 None] Transfer volume completed successfully. Jul 07 22:36:57 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.213s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Acquiring lock "cinder-27f3414a-3726-489c-85bd-97a71c9a744d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Lock "cinder-27f3414a-3726-489c-85bd-97a71c9a744d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Acquiring lock "cinder-quobyte-27f3414a-3726-489c-85bd-97a71c9a744d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:36:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Lock "cinder-quobyte-27f3414a-3726-489c-85bd-97a71c9a744d" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf38003-290d-4f44-8879-1124b9eb75a4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:58 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d Jul 07 22:36:58 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Flow 'volume_create_manager' (457ea0c9-8bd3-437b-be80-48f034396902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73698676-8a39-4e17-b486-c7e5ddc15c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73698676-8a39-4e17-b486-c7e5ddc15c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1307828033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bc9455-8122-4af3-af07-977784f99d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a441570fa27406ca4c065e893b8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:58Z,use_quota=True,user_id='1da961830aa3429c9d051e9deb0dda4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a8328f-2f7a-44cf-a948-8fa412d87435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a8328f-2f7a-44cf-a948-8fa412d87435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7882e299-3804-434c-91fd-73960411385c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7882e299-3804-434c-91fd-73960411385c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1bc9455-8122-4af3-af07-977784f99d67', 'volume_name': 'volume-e1bc9455-8122-4af3-af07-977784f99d67', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab6c896-972a-4157-a11c-652276130bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab6c896-972a-4157-a11c-652276130bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b9bcbc-99ad-4833-84e4-4c8624439fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:36:58 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Volume e1bc9455-8122-4af3-af07-977784f99d67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1bc9455-8122-4af3-af07-977784f99d67', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:36:58 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Trying to clone e1bc9455-8122-4af3-af07-977784f99d67 from image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:36:59 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 07 22:36:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d" returned: 0 in 1.197s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:36:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:59 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d Jul 07 22:36:59 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:36:59 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:36:59 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:36:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e459f4b-893c-4ee0-8a4a-47e4c5097eac]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:36:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:36:59 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD Jul 07 22:36:59 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:00 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-27f3414a-3726-489c-85bd-97a71c9a744d" returned: 0 in 1.124s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Lock "cinder-quobyte-27f3414a-3726-489c-85bd-97a71c9a744d" released by "delete_volume" :: held 2.430s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Created reservations ['a85e1ac4-52b2-4756-aa60-f84babb8eb86', 'd50c654e-024d-4efb-8c10-a7d082b6f669', '5933c4fa-7639-43e1-8c66-f42101d95f0a', '58a20847-ee5a-49b2-8b57-36bda1d74dd9'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:00 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD" returned: 0 in 1.098s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Temporary image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 is fetched for user 1da961830aa3429c9d051e9deb0dda4c. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:00 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:37:00 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bff861-1a1a-4956-b9cb-bf778498eac0]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:00 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD Jul 07 22:37:00 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:01 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.006s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:37:01 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Deleted volume successfully. Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aa1241e3-c167-41fb-85ea-5184688b929a tempest-VolumesTransfersV357Test-271360632 None] Lock "cinder-27f3414a-3726-489c-85bd-97a71c9a744d-delete_volume" released by "delete_volume" :: held 3.824s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:01 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD" returned: 0 in 1.233s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1307828033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bc9455-8122-4af3-af07-977784f99d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a441570fa27406ca4c065e893b8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:58Z,use_quota=True,user_id='1da961830aa3429c9d051e9deb0dda4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Creating volume e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:37:01 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:37:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:02 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 1073741824 Jul 07 22:37:02 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f8e7de5a-d8f7-45d0-9797-a0580d09ae9c req-97e75664-52c1-465a-86b4-7154127eb906 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Flow 'volume_create_manager' (b622fa57-0760-4933-a720-227e29861baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b6234e-21de-4638-99ef-f39f080402c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b6234e-21de-4638-99ef-f39f080402c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1113179962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f40dfa7-edc5-4f00-ae09-9132a8262293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884031dadb514999969fa79e3b050fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:02Z,use_quota=True,user_id='6a05c3c823ad48d7bfa713a2bc74d5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d10ee1d-1a54-493b-87ec-788b6b9c7d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d10ee1d-1a54-493b-87ec-788b6b9c7d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f86eaff-0ff9-414b-823d-0c12ccd00fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f86eaff-0ff9-414b-823d-0c12ccd00fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f40dfa7-edc5-4f00-ae09-9132a8262293', 'volume_name': 'volume-3f40dfa7-edc5-4f00-ae09-9132a8262293', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ca28ea-b986-4418-89fa-898670258792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ca28ea-b986-4418-89fa-898670258792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38185b8-ce67-4837-b283-896d8c8f3133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:02 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Volume 3f40dfa7-edc5-4f00-ae09-9132a8262293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f40dfa7-edc5-4f00-ae09-9132a8262293', 'volume_size': 1} Jul 07 22:37:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:03 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 1073741824" returned: 0 in 1.187s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:03 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:03 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:04 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 0 in 0.917s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f8e7de5a-d8f7-45d0-9797-a0580d09ae9c req-97e75664-52c1-465a-86b4-7154127eb906 tempest-TestStampPattern-767674385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.994s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[674d2e89-e92b-456b-b924-d240aa7a6645]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f8e7de5a-d8f7-45d0-9797-a0580d09ae9c req-97e75664-52c1-465a-86b4-7154127eb906 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Attempting download of 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}])) to volume e1bc9455-8122-4af3-af07-977784f99d67. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe1287-1f08-4ee6-aea9-abf58573a858]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_m64a1lge {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:04 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 Jul 07 22:37:04 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:04 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_m64a1lge Jul 07 22:37:04 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:05 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-f8e7de5a-d8f7-45d0-9797-a0580d09ae9c req-97e75664-52c1-465a-86b4-7154127eb906 tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1" returned: 0 in 1.052s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-f8e7de5a-d8f7-45d0-9797-a0580d09ae9c req-97e75664-52c1-465a-86b4-7154127eb906 tempest-TestStampPattern-767674385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.092s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:05 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.898s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1113179962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f40dfa7-edc5-4f00-ae09-9132a8262293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884031dadb514999969fa79e3b050fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:02Z,use_quota=True,user_id='6a05c3c823ad48d7bfa713a2bc74d5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Creating volume 3f40dfa7-edc5-4f00-ae09-9132a8262293 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:37:05 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_m64a1lge" returned: 0 in 1.019s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_m64a1lge {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:05 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 1073741824 Jul 07 22:37:05 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-f8e7de5a-d8f7-45d0-9797-a0580d09ae9c req-97e75664-52c1-465a-86b4-7154127eb906 tempest-TestStampPattern-767674385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b872503e-13bb-454d-beac-07f94b984318', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:37:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-f8e7de5a-d8f7-45d0-9797-a0580d09ae9c req-97e75664-52c1-465a-86b4-7154127eb906 tempest-TestStampPattern-767674385 None] attachment_update completed successfully. Jul 07 22:37:05 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_m64a1lge Jul 07 22:37:05 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:06 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_m64a1lge" returned: 1 in 1.103s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_m64a1lge' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:37:06 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e82963-08fe-4277-8c5d-e5fd8f724fe7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:06 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD Jul 07 22:37:06 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:06 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 1073741824" returned: 0 in 1.344s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:06 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=78,cinder:INSERT=28,cinder:UPDATE=94,cinder:DELETE=7 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:37:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:06 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 Jul 07 22:37:06 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:07 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD" returned: 0 in 1.039s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 was qcow2, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:07 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:07 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:07 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293" returned: 0 in 0.907s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] <== create_volume: return (2346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38185b8-ce67-4837-b283-896d8c8f3133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f40dfa7-edc5-4f00-ae09-9132a8262293', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5d87dc-d8a7-401b-b61c-31219992bd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Volume volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 (3f40dfa7-edc5-4f00-ae09-9132a8262293): created successfully Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5d87dc-d8a7-401b-b61c-31219992bd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Flow 'volume_create_manager' (b622fa57-0760-4933-a720-227e29861baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-575e4414-0ef1-485c-b293-f11eb200f94c tempest-VolumesTransfersV357Test-1421245025 None] Created volume successfully. Jul 07 22:37:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Acquiring lock "cinder-3f40dfa7-edc5-4f00-ae09-9132a8262293-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Lock "cinder-3f40dfa7-edc5-4f00-ae09-9132a8262293-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Acquiring lock "cinder-quobyte-3f40dfa7-edc5-4f00-ae09-9132a8262293" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Lock "cinder-quobyte-3f40dfa7-edc5-4f00-ae09-9132a8262293" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:09 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[859ca136-6a19-4f34-bec5-b15dbe95c1e6]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:09 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 Jul 07 22:37:09 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:10 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293" returned: 0 in 0.972s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:10 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293 Jul 07 22:37:10 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:10 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 0 in 3.068s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:10 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_g3aw_diodevstack@QuobyteHD, size 112.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:37:10 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Converted 112.00 MB image at 36.43 MB/s Jul 07 22:37:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:10 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 1G Jul 07 22:37:10 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:11 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3f40dfa7-edc5-4f00-ae09-9132a8262293" returned: 0 in 1.059s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Lock "cinder-quobyte-3f40dfa7-edc5-4f00-ae09-9132a8262293" released by "delete_volume" :: held 2.101s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Created reservations ['6e430214-cc2e-4164-8836-962f00adb361', 'ba2509b9-ee75-4a76-bbc5-a65a13c12cf9', '88d61f1e-3151-4246-be5c-ba19537a7026', '9500b598-4945-4b2d-be62-85e1e7035344'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:11 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:11 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:37:11 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 1G" returned: 0 in 1.265s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87c92c-b91f-4c4a-bb50-b34a2ecf4b95]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:11 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:11 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:12 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.092s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:12 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:37:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Deleted volume successfully. Jul 07 22:37:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51e974a4-0314-4080-b211-42b26ecfb885 tempest-VolumesTransfersV357Test-271360632 None] Lock "cinder-3f40dfa7-edc5-4f00-ae09-9132a8262293-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:13 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 0 in 1.271s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:13 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:13 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:14 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 1 in 1.360s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Downloaded image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}])) to volume e1bc9455-8122-4af3-af07-977784f99d67 successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Temporary image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 for user 1da961830aa3429c9d051e9deb0dda4c is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Marking volume e1bc9455-8122-4af3-af07-977784f99d67 as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Copying metadata from image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 to e1bc9455-8122-4af3-af07-977784f99d67. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Creating volume glance metadata for volume e1bc9455-8122-4af3-af07-977784f99d67 backed by image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b9bcbc-99ad-4833-84e4-4c8624439fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bc9455-8122-4af3-af07-977784f99d67', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b97ed1-c701-4a5f-9e94-3ba7c4db93b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:14 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Volume volume-e1bc9455-8122-4af3-af07-977784f99d67 (e1bc9455-8122-4af3-af07-977784f99d67): created successfully Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b97ed1-c701-4a5f-9e94-3ba7c4db93b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Flow 'volume_create_manager' (457ea0c9-8bd3-437b-be80-48f034396902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-dfea9db1-0f7c-4a2e-b27f-07220ce1949a tempest-VolumesExtendTest-1849686529 None] Created volume successfully. Jul 07 22:37:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:15 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b7a372-b2f8-4de4-8bf7-fd73cf98c27d]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:15 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:15 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:16 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 0 in 1.158s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:16 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:16 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-2361528d-6710-41ac-8524-e139e2d9a96b req-1cc84bf3-fa49-4b16-b7cc-689833e1209a tempest-TestStampPattern-767674385 None] Terminate volume connection completed successfully. Jul 07 22:37:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-2361528d-6710-41ac-8524-e139e2d9a96b req-1cc84bf3-fa49-4b16-b7cc-689833e1209a tempest-TestStampPattern-767674385 None] Deleting attachment b872503e-13bb-454d-beac-07f94b984318. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:37:17 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 1 in 1.275s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:37:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 2G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 2G" returned: 0 in 0.118s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.618s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-45c37324-80ea-475b-beb9-429a9affa41d tempest-VolumesExtendTest-1849686529 None] Extend volume completed successfully. Jul 07 22:37:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Acquiring lock "cinder-e1bc9455-8122-4af3-af07-977784f99d67-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Lock "cinder-e1bc9455-8122-4af3-af07-977784f99d67-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Acquiring lock "cinder-quobyte-e1bc9455-8122-4af3-af07-977784f99d67" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Lock "cinder-quobyte-e1bc9455-8122-4af3-af07-977784f99d67" acquired by "delete_volume" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:19 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84159ee-3639-4e54-8f69-80a5833daf08]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:19 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:19 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Creating offline snapshot bec2ce0a-4d80-42e9-9636-b38b74c91742 of volume 6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:37:19 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e021b17e-61b2-4265-8a2c-cd2b8a393dfd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:19 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 Jul 07 22:37:19 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:20 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 0 in 1.221s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:20 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:20 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:20 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1" returned: 0 in 1.276s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:20 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 1G Jul 07 22:37:20 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:21 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 1 in 1.268s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:37:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:21 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67 Jul 07 22:37:21 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:22 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 1G" returned: 0 in 1.319s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:22 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 Jul 07 22:37:22 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:22 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1bc9455-8122-4af3-af07-977784f99d67" returned: 0 in 1.009s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Lock "cinder-quobyte-e1bc9455-8122-4af3-af07-977784f99d67" released by "delete_volume" :: held 3.612s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Created reservations ['a4d15950-614a-4c11-ad6e-3b1a0823bc7f', '5491ce83-29c3-4fb7-b7af-94c67454bf7a', '2f6b9d0f-6fe6-4159-afcb-e7b2a90c6dfb', '51ae31ce-3070-4db9-9193-088538a71559'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:22 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:37:22 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:23 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742" returned: 0 in 1.187s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:23 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 is being set with open permissions: ugo+rw Jul 07 22:37:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:23 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 Jul 07 22:37:23 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:24 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.233s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:37:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Deleted volume successfully. Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-29cd0135-6a60-431c-acd5-21b872789bdc tempest-VolumesExtendTest-1849686529 None] Lock "cinder-e1bc9455-8122-4af3-af07-977784f99d67-delete_volume" released by "delete_volume" :: held 5.259s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Flow 'volume_create_manager' (e24f7cd0-9b5a-46bd-89b9-67cb7e2ea799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbeaa59-a1bc-47e0-9b00-0fad4dbb009c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbeaa59-a1bc-47e0-9b00-0fad4dbb009c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1702933212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cce71c-ef99-4005-ba9d-9c9f2004d9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a441570fa27406ca4c065e893b8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:24Z,use_quota=True,user_id='1da961830aa3429c9d051e9deb0dda4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e38e1b-20ad-448f-bfde-f398b9a1c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e38e1b-20ad-448f-bfde-f398b9a1c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bee329e-6fbb-4c8a-b44f-804a8784ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bee329e-6fbb-4c8a-b44f-804a8784ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69cce71c-ef99-4005-ba9d-9c9f2004d9dc', 'volume_name': 'volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96295bf-4e67-4a72-8ab1-9f355ee1025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96295bf-4e67-4a72-8ab1-9f355ee1025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e011b92-2b22-4d16-abfe-e5ca1f13eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:24 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Volume 69cce71c-ef99-4005-ba9d-9c9f2004d9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc', 'volume_size': 1} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:24 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742" returned: 0 in 1.258s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:24 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.info Jul 07 22:37:24 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:25 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.info" returned: 0 in 0.884s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:25 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.info is being set with open permissions: ugo+rw Jul 07 22:37:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:25 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.info Jul 07 22:37:25 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:26 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.info" returned: 0 in 0.905s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.997s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1702933212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cce71c-ef99-4005-ba9d-9c9f2004d9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a441570fa27406ca4c065e893b8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:24Z,use_quota=True,user_id='1da961830aa3429c9d051e9deb0dda4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Creating volume 69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:37:26 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:37:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:26 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc 1073741824 Jul 07 22:37:26 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-18e835f2-3c39-4faf-84ef-f92e4d134513 tempest-TestStampPattern-767674385 None] Create snapshot completed successfully Jul 07 22:37:27 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc 1073741824" returned: 0 in 1.345s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:28 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc Jul 07 22:37:28 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:28 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" returned: 0 in 0.921s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] <== create_volume: return (2350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:37:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e011b92-2b22-4d16-abfe-e5ca1f13eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6828af5-d259-4730-ae5d-be1ebde3fba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Volume volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc (69cce71c-ef99-4005-ba9d-9c9f2004d9dc): created successfully Jul 07 22:37:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6828af5-d259-4730-ae5d-be1ebde3fba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Flow 'volume_create_manager' (e24f7cd0-9b5a-46bd-89b9-67cb7e2ea799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-af5ea9e0-e233-4a8a-9bad-9313b88b62c9 tempest-VolumesExtendTest-1849686529 None] Created volume successfully. Jul 07 22:37:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Creating offline snapshot 343efcd6-6949-4666-a4b3-c72592b7348f of volume 69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:37:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0568e19f-e480-4688-b4e1-49b6ec562f76]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:30 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc Jul 07 22:37:30 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:31 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" returned: 0 in 1.157s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:31 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f 1G Jul 07 22:37:31 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:32 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f 1G" returned: 0 in 1.534s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:32 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f Jul 07 22:37:32 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:33 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f" returned: 0 in 1.097s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:33 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f is being set with open permissions: ugo+rw Jul 07 22:37:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:33 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f Jul 07 22:37:33 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:34 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f" returned: 0 in 1.029s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:34 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.info Jul 07 22:37:34 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:36 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.info" returned: 0 in 1.111s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:36 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.info is being set with open permissions: ugo+rw Jul 07 22:37:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:36 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.info Jul 07 22:37:36 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:37 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.info" returned: 0 in 1.117s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.234s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-dac33415-b19c-4490-802e-3bb9dec403be tempest-VolumesExtendTest-1849686529 None] Create snapshot completed successfully Jul 07 22:37:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-44d26692-3271-4ca4-9269-e8db232b2e91 tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-44d26692-3271-4ca4-9269-e8db232b2e91 tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:38 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4511ebc-5be0-44df-a52e-0f2ad2b98e49]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44d26692-3271-4ca4-9269-e8db232b2e91 tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:39 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc Jul 07 22:37:39 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=62,cinder:SELECT=63,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Flow 'volume_create_manager' (d9b525c9-4ec7-49a3-b2a9-5bf728a7e2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2c94ea-2cfb-4a9a-8834-be7aadc344ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2c94ea-2cfb-4a9a-8834-be7aadc344ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-206947583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c44571c-0bd4-458d-a3af-82049da29cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b0a04b45524154b49a080d7742b0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:40Z,use_quota=True,user_id='1d2fa398995d40c197a1634c695fdfef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4570b4f-e154-441e-81c1-3140c8624ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4570b4f-e154-441e-81c1-3140c8624ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb6e7e0-e3e7-4508-a92a-2947a3c73a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb6e7e0-e3e7-4508-a92a-2947a3c73a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c44571c-0bd4-458d-a3af-82049da29cf4', 'volume_name': 'volume-5c44571c-0bd4-458d-a3af-82049da29cf4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f181438-08d5-4552-8d41-56d225efcad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f181438-08d5-4552-8d41-56d225efcad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70727bad-b6fd-4a7d-ab7d-49dabd4f98a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:39 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Volume 5c44571c-0bd4-458d-a3af-82049da29cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c44571c-0bd4-458d-a3af-82049da29cf4', 'volume_size': 1} Jul 07 22:37:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:40 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44d26692-3271-4ca4-9269-e8db232b2e91 tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" returned: 0 in 1.252s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44d26692-3271-4ca4-9269-e8db232b2e91 tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f 2G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44d26692-3271-4ca4-9269-e8db232b2e91 tempest-VolumesExtendTest-1849686529 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f 2G" returned: 0 in 0.248s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-44d26692-3271-4ca4-9269-e8db232b2e91 tempest-VolumesExtendTest-1849686529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.563s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-206947583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c44571c-0bd4-458d-a3af-82049da29cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b0a04b45524154b49a080d7742b0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:40Z,use_quota=True,user_id='1d2fa398995d40c197a1634c695fdfef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Creating volume 5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:37:40 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:37:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:40 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 1073741824 Jul 07 22:37:40 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-44d26692-3271-4ca4-9269-e8db232b2e91 tempest-VolumesExtendTest-1849686529 None] Extend volume completed successfully. Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Flow 'volume_create_manager' (29561725-2eac-49fe-9938-ac69614eec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbf6282-560a-4403-93f5-74186d371dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbf6282-560a-4403-93f5-74186d371dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-630130201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d04d89-736f-4b45-8e13-973cc63c8c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ffd35556e04adfb8ad13052b0409a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bec2ce0a-4d80-42e9-9636-b38b74c91742,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:41Z,use_quota=True,user_id='127d72c935f241e5a785b0e34100849b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab6a477-a700-47f6-afff-afe74cbc3ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab6a477-a700-47f6-afff-afe74cbc3ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd3c5fa-91eb-415b-9d5c-3f50b58a8e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd3c5fa-91eb-415b-9d5c-3f50b58a8e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4d04d89-736f-4b45-8e13-973cc63c8c08', 'volume_name': 'volume-c4d04d89-736f-4b45-8e13-973cc63c8c08', 'volume_size': 1, 'snapshot_id': 'bec2ce0a-4d80-42e9-9636-b38b74c91742'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bf678a-84e7-41da-ae57-995a427cebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bf678a-84e7-41da-ae57-995a427cebc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3588159d-2188-4bb7-a8b1-49a07da379af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:41 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Volume c4d04d89-736f-4b45-8e13-973cc63c8c08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4d04d89-736f-4b45-8e13-973cc63c8c08', 'volume_size': 1, 'snapshot_id': 'bec2ce0a-4d80-42e9-9636-b38b74c91742'} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Acquiring lock "cinder-343efcd6-6949-4666-a4b3-c72592b7348f-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Lock "cinder-343efcd6-6949-4666-a4b3-c72592b7348f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Acquiring lock "cinder-quobyte-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Lock "cinder-quobyte-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Acquiring lock "cinder-quobyte-343efcd6-6949-4666-a4b3-c72592b7348f" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Lock "cinder-quobyte-343efcd6-6949-4666-a4b3-c72592b7348f" acquired by "_delete_snapshot" :: waited 0.086s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Deleting offline snapshot 343efcd6-6949-4666-a4b3-c72592b7348f of volume 69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] snapshot_file for this snap is: volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75685fc-38ba-4677-b8dd-c1bb5ae0c498]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:42 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f Jul 07 22:37:42 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:42 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 1073741824" returned: 0 in 2.279s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:42 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:37:42 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:43 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f" returned: 0 in 1.645s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:37:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4470e204-b6ab-4c60-b03c-db8a22d39a72]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:43 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc Jul 07 22:37:43 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:44 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 1.684s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] <== create_volume: return (4099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.104s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.099s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-quobyte-bec2ce0a-4d80-42e9-9636-b38b74c91742-c4d04d89-736f-4b45-8e13-973cc63c8c08" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70727bad-b6fd-4a7d-ab7d-49dabd4f98a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c44571c-0bd4-458d-a3af-82049da29cf4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952a21ea-6369-4dfb-9205-472b2d9bc2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-bec2ce0a-4d80-42e9-9636-b38b74c91742-c4d04d89-736f-4b45-8e13-973cc63c8c08" acquired by "_create_volume_from_snapshot" :: waited 0.073s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Creating volume c4d04d89-736f-4b45-8e13-973cc63c8c08 from snapshot bec2ce0a-4d80-42e9-9636-b38b74c91742 {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-quobyte-c4d04d89-736f-4b45-8e13-973cc63c8c08" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:44 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Volume volume-5c44571c-0bd4-458d-a3af-82049da29cf4 (5c44571c-0bd4-458d-a3af-82049da29cf4): created successfully Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952a21ea-6369-4dfb-9205-472b2d9bc2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Flow 'volume_create_manager' (d9b525c9-4ec7-49a3-b2a9-5bf728a7e2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-c4d04d89-736f-4b45-8e13-973cc63c8c08" acquired by "_copy_volume_from_snapshot" :: waited 0.069s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] snapshot: bec2ce0a-4d80-42e9-9636-b38b74c91742, volume: c4d04d89-736f-4b45-8e13-973cc63c8c08, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:37:44 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9c26f59d-f234-4e46-9b4f-c08bbd138c14 tempest-VolumesActionsTest-252134381 None] Created volume successfully. Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547636d-bf12-4ed1-84a9-e56762d92dea]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:45 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 Jul 07 22:37:45 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:45 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" returned: 0 in 1.679s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:45 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f Jul 07 22:37:45 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Flow 'volume_create_manager' (a4ddfc11-6c96-43a7-a0c6-cbb45ee62381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eac8b8-e407-461d-88ce-ac4120da7ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eac8b8-e407-461d-88ce-ac4120da7ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-134063543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d16be22-2a75-4005-9a22-93a311aaf9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3686db82643a4f46af682c828ff6b2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:46Z,use_quota=True,user_id='611e6d41343441d2a153ad4ece063d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0521779-805a-4077-82e6-1c216b31df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0521779-805a-4077-82e6-1c216b31df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9132a5f4-68cf-465c-89bd-964ea4473a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9132a5f4-68cf-465c-89bd-964ea4473a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d16be22-2a75-4005-9a22-93a311aaf9ba', 'volume_name': 'volume-0d16be22-2a75-4005-9a22-93a311aaf9ba', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90285a61-b870-4ea2-b71e-3a42db53e2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90285a61-b870-4ea2-b71e-3a42db53e2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf94b6f-0560-4ac2-9b70-1af092ed3247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:37:46 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Volume 0d16be22-2a75-4005-9a22-93a311aaf9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d16be22-2a75-4005-9a22-93a311aaf9ba', 'volume_size': 1} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:46 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f" returned: 0 in 1.715s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:47 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f Jul 07 22:37:47 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:47 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742" returned: 0 in 2.256s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:37:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:37:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:37:47 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e46cd52-3e87-4f32-9808-5164f089ef76]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:47 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 Jul 07 22:37:47 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:48 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc.343efcd6-6949-4666-a4b3-c72592b7348f" returned: 0 in 1.313s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Lock "cinder-quobyte-343efcd6-6949-4666-a4b3-c72592b7348f" released by "_delete_snapshot" :: held 6.635s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Lock "cinder-quobyte-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" released by "delete_snapshot" :: held 6.732s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:48 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Created reservations ['b70dc057-f978-4856-aabe-9e8b802fbfa3', '3f01532b-318a-4cfc-a66c-5a324ff659b8', '46c0cda4-653f-463c-bae7-93e0f94079da', '430a863d-5f22-4ff7-a743-a501d8bf1f39'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Delete snapshot completed successfully. Jul 07 22:37:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f51805e7-a5b1-4bfd-954a-631d00aca7be tempest-VolumesExtendTest-1849686529 None] Lock "cinder-343efcd6-6949-4666-a4b3-c72592b7348f-delete_snapshot" released by "delete_snapshot" :: held 6.986s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:48 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1" returned: 0 in 1.387s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:48 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:37:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:48 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 Jul 07 22:37:48 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Acquiring lock "cinder-69cce71c-ef99-4005-ba9d-9c9f2004d9dc-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Lock "cinder-69cce71c-ef99-4005-ba9d-9c9f2004d9dc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Acquiring lock "cinder-quobyte-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:37:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Lock "cinder-quobyte-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" acquired by "delete_volume" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:37:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af4e6b5-9d4b-4b17-8ba1-28f87cc014bd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:49 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc Jul 07 22:37:49 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:51 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" returned: 0 in 2.139s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:51 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc Jul 07 22:37:51 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:54 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" returned: 0 in 3.002s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Lock "cinder-quobyte-69cce71c-ef99-4005-ba9d-9c9f2004d9dc" released by "delete_volume" :: held 5.327s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Created reservations ['d6d640e5-eb15-4234-887e-aa09588ef021', '9f4e9622-b9eb-4bdd-b69f-58117bbbe2d2', '7c71bc01-7787-4375-b44b-31ab9e68980a', '87a556a7-82e6-4d88-a99d-8f5533ff0a5f'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:55 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:37:55 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:37:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:56 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:37:56 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:37:58 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 2.966s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:37:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Deleted volume successfully. Jul 07 22:37:58 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d4ff128b-c470-4635-9538-258bf1b97138 tempest-VolumesExtendTest-1849686529 None] Lock "cinder-69cce71c-ef99-4005-ba9d-9c9f2004d9dc-delete_volume" released by "delete_volume" :: held 9.179s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08" returned: 0 in 9.945s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d8961d-65aa-4ea6-ad60-3f1ed5d3cc66]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:37:58 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 2.755s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:37:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:37:58 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 Jul 07 22:37:58 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:00 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1" returned: 0 in 1.647s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:00 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1, size 1024.00 MB, duration 9.95 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:38:00 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Converted 1024.00 MB image at 102.91 MB/s Jul 07 22:38:00 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 is being set with open permissions: ugo+rw Jul 07 22:38:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:00 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 Jul 07 22:38:00 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:01 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08" returned: 0 in 1.106s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-c4d04d89-736f-4b45-8e13-973cc63c8c08" released by "_copy_volume_from_snapshot" :: held 16.641s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-bec2ce0a-4d80-42e9-9636-b38b74c91742-c4d04d89-736f-4b45-8e13-973cc63c8c08" released by "_create_volume_from_snapshot" :: held 16.751s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.830s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.537s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-134063543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d16be22-2a75-4005-9a22-93a311aaf9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3686db82643a4f46af682c828ff6b2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:46Z,use_quota=True,user_id='611e6d41343441d2a153ad4ece063d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Creating volume 0d16be22-2a75-4005-9a22-93a311aaf9ba {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:01 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:01 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba 1073741824 Jul 07 22:38:01 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3588159d-2188-4bb7-a8b1-49a07da379af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d04d89-736f-4b45-8e13-973cc63c8c08', 'volume_size': 1, 'snapshot_id': 'bec2ce0a-4d80-42e9-9636-b38b74c91742'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cefbff8-be9e-4894-b2e6-b564be76d3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:01 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Volume volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 (c4d04d89-736f-4b45-8e13-973cc63c8c08): created successfully Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cefbff8-be9e-4894-b2e6-b564be76d3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Flow 'volume_create_manager' (29561725-2eac-49fe-9938-ac69614eec53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:01 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e1bd84f4-57c6-4a45-9fb2-1e11e34da319 tempest-TestStampPattern-767674385 None] Created volume successfully. Jul 07 22:38:03 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba 1073741824" returned: 0 in 1.635s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:03 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba Jul 07 22:38:03 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:04 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba" returned: 0 in 1.166s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] <== create_volume: return (2873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.880s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf94b6f-0560-4ac2-9b70-1af092ed3247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d16be22-2a75-4005-9a22-93a311aaf9ba', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dca0457-36d6-43f5-9a88-239fd37ff3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Volume volume-0d16be22-2a75-4005-9a22-93a311aaf9ba (0d16be22-2a75-4005-9a22-93a311aaf9ba): created successfully Jul 07 22:38:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dca0457-36d6-43f5-9a88-239fd37ff3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Flow 'volume_create_manager' (a4ddfc11-6c96-43a7-a0c6-cbb45ee62381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:04 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9c10fdf0-a909-4a89-ac30-872535387cdf tempest-TestMinimumBasicScenario-1829228113 None] Created volume successfully. Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=60,cinder:SELECT=38,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-4dce62a2-c1f0-4b1e-b341-caec2c526005 req-23988945-735f-41c6-a79b-c9ae01017b5d tempest-TestMinimumBasicScenario-1829228113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-4dce62a2-c1f0-4b1e-b341-caec2c526005 req-23988945-735f-41c6-a79b-c9ae01017b5d tempest-TestMinimumBasicScenario-1829228113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5120f86-faec-4dfc-8266-bea942188b60]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-4dce62a2-c1f0-4b1e-b341-caec2c526005 req-23988945-735f-41c6-a79b-c9ae01017b5d tempest-TestMinimumBasicScenario-1829228113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:09 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba Jul 07 22:38:09 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Flow 'volume_create_manager' (b5eee1ca-a98e-40a7-aefc-326f4b254d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2c7fb8-2c78-4764-a260-46ae73e579f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2c7fb8-2c78-4764-a260-46ae73e579f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-163162766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57fda28-bc14-4996-951b-3029acb93af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0616b1be3b4d86b3bbcb62ec347e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:10Z,use_quota=True,user_id='c03f50a9a5fd43f298b45fe251ee15d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d751714-2385-4ab7-a40f-d798d7afaadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d751714-2385-4ab7-a40f-d798d7afaadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3455087c-12c5-4941-873d-0e5a8bb4e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3455087c-12c5-4941-873d-0e5a8bb4e19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57fda28-bc14-4996-951b-3029acb93af1', 'volume_name': 'volume-f57fda28-bc14-4996-951b-3029acb93af1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73053b8f-58bd-4088-8452-31ef542f3122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73053b8f-58bd-4088-8452-31ef542f3122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf257c4d-6852-449c-8992-0e96d8d7e81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:09 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Volume f57fda28-bc14-4996-951b-3029acb93af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57fda28-bc14-4996-951b-3029acb93af1', 'volume_size': 1} Jul 07 22:38:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:10 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-4dce62a2-c1f0-4b1e-b341-caec2c526005 req-23988945-735f-41c6-a79b-c9ae01017b5d tempest-TestMinimumBasicScenario-1829228113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba" returned: 0 in 1.485s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-4dce62a2-c1f0-4b1e-b341-caec2c526005 req-23988945-735f-41c6-a79b-c9ae01017b5d tempest-TestMinimumBasicScenario-1829228113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.540s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.975s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-163162766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57fda28-bc14-4996-951b-3029acb93af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0616b1be3b4d86b3bbcb62ec347e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:10Z,use_quota=True,user_id='c03f50a9a5fd43f298b45fe251ee15d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Creating volume f57fda28-bc14-4996-951b-3029acb93af1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:38:10 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:10 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 1073741824 Jul 07 22:38:10 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-4dce62a2-c1f0-4b1e-b341-caec2c526005 req-23988945-735f-41c6-a79b-c9ae01017b5d tempest-TestMinimumBasicScenario-1829228113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-0d16be22-2a75-4005-9a22-93a311aaf9ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd22ac41a-88c9-4502-97eb-d6f2abaca757', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:38:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-4dce62a2-c1f0-4b1e-b341-caec2c526005 req-23988945-735f-41c6-a79b-c9ae01017b5d tempest-TestMinimumBasicScenario-1829228113 None] attachment_update completed successfully. Jul 07 22:38:13 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 1073741824" returned: 0 in 2.343s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:13 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 Jul 07 22:38:13 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cab18d46-209a-4963-a42f-a4321721213b tempest-VolumesActionsTest-252134381 None] Acquiring lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4" by "attach_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cab18d46-209a-4963-a42f-a4321721213b tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4" acquired by "attach_volume" :: waited 0.063s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cab18d46-209a-4963-a42f-a4321721213b tempest-VolumesActionsTest-252134381 None] Attaching volume 5c44571c-0bd4-458d-a3af-82049da29cf4 to instance 8ee5fbbe-f8df-434e-b666-ba03e1e724af at mountpoint /dev/vdb on host None. Jul 07 22:38:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cab18d46-209a-4963-a42f-a4321721213b tempest-VolumesActionsTest-252134381 None] Attach volume completed successfully. Jul 07 22:38:14 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1" returned: 0 in 1.300s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] <== create_volume: return (3729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.737s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cab18d46-209a-4963-a42f-a4321721213b tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4" released by "attach_volume" :: held 0.246s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf257c4d-6852-449c-8992-0e96d8d7e81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57fda28-bc14-4996-951b-3029acb93af1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05320db3-996b-42ce-bbf8-a6ac3e3fdd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:38:14 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Volume volume-f57fda28-bc14-4996-951b-3029acb93af1 (f57fda28-bc14-4996-951b-3029acb93af1): created successfully Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05320db3-996b-42ce-bbf8-a6ac3e3fdd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Flow 'volume_create_manager' (b5eee1ca-a98e-40a7-aefc-326f4b254d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:38:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-01b1caff-cbcd-4b89-ab01-71631e175b29 tempest-VolumesNegativeTest-682866470 None] Created volume successfully. Jul 07 22:38:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2fca53-4062-41a3-8eaa-488680fa81d8 tempest-VolumesActionsTest-252134381 None] Acquiring lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-detach_volume" by "detach_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2fca53-4062-41a3-8eaa-488680fa81d8 tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ea2fca53-4062-41a3-8eaa-488680fa81d8 tempest-VolumesActionsTest-252134381 None] Detaching volume 5c44571c-0bd4-458d-a3af-82049da29cf4 from instance 8ee5fbbe-f8df-434e-b666-ba03e1e724af. Jul 07 22:38:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ea2fca53-4062-41a3-8eaa-488680fa81d8 tempest-VolumesActionsTest-252134381 None] Detach volume completed successfully. Jul 07 22:38:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ea2fca53-4062-41a3-8eaa-488680fa81d8 tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:25 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=32,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:38:25 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:38:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-3f42b838-6881-45b7-afef-5a577a7f4002 req-6e090fc5-87c1-4460-8879-291d4a6ad2bf tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-3f42b838-6881-45b7-afef-5a577a7f4002 req-6e090fc5-87c1-4460-8879-291d4a6ad2bf tempest-TestStampPattern-767674385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d05c397-24ac-4d4e-9834-47dbfe99a1a4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-3f42b838-6881-45b7-afef-5a577a7f4002 req-6e090fc5-87c1-4460-8879-291d4a6ad2bf tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:43 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 Jul 07 22:38:43 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-761b0cae-800d-4700-bf69-56bf9100cea0 tempest-VolumesActionsTest-252134381 None] Acquiring lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4" by "attach_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-761b0cae-800d-4700-bf69-56bf9100cea0 tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4" acquired by "attach_volume" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:44 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-761b0cae-800d-4700-bf69-56bf9100cea0 tempest-VolumesActionsTest-252134381 None] Attaching volume 5c44571c-0bd4-458d-a3af-82049da29cf4 to instance 58142c8e-603c-4895-a22e-a478ccfa74a5 at mountpoint /dev/vdb on host None. Jul 07 22:38:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-761b0cae-800d-4700-bf69-56bf9100cea0 tempest-VolumesActionsTest-252134381 None] Attach volume completed successfully. Jul 07 22:38:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-761b0cae-800d-4700-bf69-56bf9100cea0 tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4" released by "attach_volume" :: held 0.194s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:45 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-3f42b838-6881-45b7-afef-5a577a7f4002 req-6e090fc5-87c1-4460-8879-291d4a6ad2bf tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08" returned: 0 in 1.404s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-3f42b838-6881-45b7-afef-5a577a7f4002 req-6e090fc5-87c1-4460-8879-291d4a6ad2bf tempest-TestStampPattern-767674385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.438s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-3f42b838-6881-45b7-afef-5a577a7f4002 req-6e090fc5-87c1-4460-8879-291d4a6ad2bf tempest-TestStampPattern-767674385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-c4d04d89-736f-4b45-8e13-973cc63c8c08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac563ee2-9045-44c9-93d1-a20721d4ce38', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:38:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-3f42b838-6881-45b7-afef-5a577a7f4002 req-6e090fc5-87c1-4460-8879-291d4a6ad2bf tempest-TestStampPattern-767674385 None] attachment_update completed successfully. Jul 07 22:38:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d0eeae7a-49be-4f9b-b1c9-b76d188b2bf3 tempest-VolumesActionsTest-252134381 None] Acquiring lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-detach_volume" by "detach_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d0eeae7a-49be-4f9b-b1c9-b76d188b2bf3 tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d0eeae7a-49be-4f9b-b1c9-b76d188b2bf3 tempest-VolumesActionsTest-252134381 None] Detaching volume 5c44571c-0bd4-458d-a3af-82049da29cf4 from instance 58142c8e-603c-4895-a22e-a478ccfa74a5. Jul 07 22:38:46 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d0eeae7a-49be-4f9b-b1c9-b76d188b2bf3 tempest-VolumesActionsTest-252134381 None] Detach volume completed successfully. Jul 07 22:38:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d0eeae7a-49be-4f9b-b1c9-b76d188b2bf3 tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-5d7792da-50dc-46c4-b8d0-d99fb66fe36e req-b8ac64c8-5f67-410d-9aef-96741638a815 tempest-TestStampPattern-767674385 None] Terminate volume connection completed successfully. Jul 07 22:38:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-5d7792da-50dc-46c4-b8d0-d99fb66fe36e req-b8ac64c8-5f67-410d-9aef-96741638a815 tempest-TestStampPattern-767674385 None] Deleting attachment ac563ee2-9045-44c9-93d1-a20721d4ce38. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:38:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:38:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:55 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:38:55 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Acquiring lock "cinder-f57fda28-bc14-4996-951b-3029acb93af1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Lock "cinder-f57fda28-bc14-4996-951b-3029acb93af1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Acquiring lock "cinder-quobyte-f57fda28-bc14-4996-951b-3029acb93af1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Lock "cinder-quobyte-f57fda28-bc14-4996-951b-3029acb93af1" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[121e10f6-8f4a-41cd-a080-b49378d1bf2a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:56 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 Jul 07 22:38:56 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:56 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.144s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:38:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:38:57 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1" returned: 0 in 1.086s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:57 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1 Jul 07 22:38:57 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcea011-4073-4398-870b-9f3549fa75b1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:58 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:38:58 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:58 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f57fda28-bc14-4996-951b-3029acb93af1" returned: 0 in 0.869s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Lock "cinder-quobyte-f57fda28-bc14-4996-951b-3029acb93af1" released by "delete_volume" :: held 2.035s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Created reservations ['dacaecc9-f352-4126-8cae-1fb21634f127', 'f081e3f1-a96b-49bf-bd10-2e57a5b39f10', '784cf090-96ee-44ae-9020-57b3560e7d9e', '038c7a9f-98f1-4cca-94d7-ceac171d4133'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:38:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:58 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:38:58 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:59 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 1.089s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a2e7d3-bbea-47bc-a3ad-9b091025feb8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:38:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:38:59 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:38:59 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:38:59 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 07 22:38:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.046s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:38:59 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:38:59 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Deleted volume successfully. Jul 07 22:38:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58623f9c-da06-4e9f-9e6a-7b9d49317b7e tempest-VolumesNegativeTest-682866470 None] Lock "cinder-f57fda28-bc14-4996-951b-3029acb93af1-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:00 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 1.251s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.218708c4-ae87-4a43-ad93-84934e24de67vn12vwoi.img {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:00 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.218708c4-ae87-4a43-ad93-84934e24de67vn12vwoi.img Jul 07 22:39:00 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-c4d04d89-736f-4b45-8e13-973cc63c8c08-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:05 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Flow 'volume_create_manager' (b67fadd9-38b6-4a0e-88b3-a506bda7c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77945ae5-9ff2-4885-b76d-4723db77e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Lock "cinder-c4d04d89-736f-4b45-8e13-973cc63c8c08-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77945ae5-9ff2-4885-b76d-4723db77e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2107295019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b96e5f1-54a1-488f-9a18-6f967e9b9a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8406ce2b8603467aadc77dfc8d582d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:06Z,use_quota=True,user_id='cda5af8f39f744a793c6358990329021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915fb415-3c2c-4b44-9d5e-8f0b15ac4265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915fb415-3c2c-4b44-9d5e-8f0b15ac4265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af725bce-d4f9-4a93-be22-d63103e41968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af725bce-d4f9-4a93-be22-d63103e41968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b96e5f1-54a1-488f-9a18-6f967e9b9a04', 'volume_name': 'volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f621593f-850c-4126-b0c2-68aea4231917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f621593f-850c-4126-b0c2-68aea4231917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7ac954-30a3-4bbc-87db-9aa9451a75e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:06 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Volume 1b96e5f1-54a1-488f-9a18-6f967e9b9a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04', 'volume_size': 1} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-quobyte-c4d04d89-736f-4b45-8e13-973cc63c8c08" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-c4d04d89-736f-4b45-8e13-973cc63c8c08" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f786de-2ba1-4376-a5aa-d4339ab2742e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:06 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 Jul 07 22:39:06 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:07 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.218708c4-ae87-4a43-ad93-84934e24de67vn12vwoi.img" returned: 0 in 6.845s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[156431d5-9a42-4b35-a5e7-931472935c38]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:07 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:39:07 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:07 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08" returned: 0 in 1.388s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:07 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08 Jul 07 22:39:07 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:08 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 1.042s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.218708c4-ae87-4a43-ad93-84934e24de67vn12vwoi.img {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:39:08 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Converted 1024.00 MB image at 149.56 MB/s Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] 218708c4-ae87-4a43-ad93-84934e24de67 was raw, no need to convert to raw {{(pid=87612) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 22:39:08 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c4d04d89-736f-4b45-8e13-973cc63c8c08" returned: 0 in 0.731s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-c4d04d89-736f-4b45-8e13-973cc63c8c08" released by "delete_volume" :: held 2.207s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Created reservations ['7db5014a-872f-4ad8-b987-9c126939d3ca', 'a11822c8-c622-4d2d-80b2-a52c8ed5525d', '50973700-67d2-48bb-8ff7-8974748c7119', 'c5a88353-030c-43a6-bc2c-b98545db6712'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:08 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:39:08 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:09 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.734s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:09 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Deleted volume successfully. Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856ef049-d6ec-4ff8-9032-9d98f83f8ec1 tempest-TestStampPattern-767674385 None] Lock "cinder-c4d04d89-736f-4b45-8e13-973cc63c8c08-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-bec2ce0a-4d80-42e9-9636-b38b74c91742-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Lock "cinder-bec2ce0a-4d80-42e9-9636-b38b74c91742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-quobyte-6225b36f-ce4e-439d-9d40-9cde47db6ed1" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-6225b36f-ce4e-439d-9d40-9cde47db6ed1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-quobyte-bec2ce0a-4d80-42e9-9636-b38b74c91742" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-bec2ce0a-4d80-42e9-9636-b38b74c91742" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Deleting offline snapshot bec2ce0a-4d80-42e9-9636-b38b74c91742 of volume 6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] snapshot_file for this snap is: volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dae9fa-0060-4434-8f9b-ed824c840b22]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:09 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 Jul 07 22:39:09 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:10 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742" returned: 0 in 0.919s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:39:10 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[309af23a-f015-4093-b206-ace469aa0fb9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:10 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 Jul 07 22:39:10 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:11 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1" returned: 0 in 0.846s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:11 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 Jul 07 22:39:11 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:12 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742" returned: 0 in 0.898s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:12 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742 Jul 07 22:39:12 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:13 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1.bec2ce0a-4d80-42e9-9636-b38b74c91742" returned: 0 in 0.723s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-bec2ce0a-4d80-42e9-9636-b38b74c91742" released by "_delete_snapshot" :: held 3.545s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-6225b36f-ce4e-439d-9d40-9cde47db6ed1" released by "delete_snapshot" :: held 3.579s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:13 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Created reservations ['5d1a6ed3-4050-4f14-87c6-7f381608ff1e', '1a637aeb-83b9-4f43-a4ea-b2b74f697d38', '176801ba-750c-483e-847c-e61e55f7caa9', 'd212aafe-8f59-4958-9782-e59218c80607'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Delete snapshot completed successfully. Jul 07 22:39:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-856e93eb-4f15-4146-ab0d-85e3b9862a5a tempest-TestStampPattern-767674385 None] Lock "cinder-bec2ce0a-4d80-42e9-9636-b38b74c91742-delete_snapshot" released by "delete_snapshot" :: held 3.789s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-6225b36f-ce4e-439d-9d40-9cde47db6ed1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Lock "cinder-6225b36f-ce4e-439d-9d40-9cde47db6ed1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Acquiring lock "cinder-quobyte-6225b36f-ce4e-439d-9d40-9cde47db6ed1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-6225b36f-ce4e-439d-9d40-9cde47db6ed1" acquired by "delete_volume" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[be262f91-7e04-4dab-9108-43e4a6ad8e24]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:23 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 Jul 07 22:39:23 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-c3b306fb-999d-464c-9a0f-0bbbe18e302d req-54cd56e2-bce6-4b57-9f35-d8ca5838471c tempest-TestMinimumBasicScenario-1829228113 None] Terminate volume connection completed successfully. Jul 07 22:39:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-c3b306fb-999d-464c-9a0f-0bbbe18e302d req-54cd56e2-bce6-4b57-9f35-d8ca5838471c tempest-TestMinimumBasicScenario-1829228113 None] Deleting attachment d22ac41a-88c9-4502-97eb-d6f2abaca757. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:39:24 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1" returned: 0 in 1.099s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:24 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1 Jul 07 22:39:24 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:25 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6225b36f-ce4e-439d-9d40-9cde47db6ed1" returned: 0 in 0.774s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Lock "cinder-quobyte-6225b36f-ce4e-439d-9d40-9cde47db6ed1" released by "delete_volume" :: held 2.006s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Created reservations ['ce2a5165-f4db-416d-bbe9-960f96ae7df0', '63b32132-aba2-4198-aada-1a9afa8182a5', '34f78167-373e-4bd4-82b6-05bad1987429', '56c2feea-dbd5-4c5b-b321-8ad30f1e4b3e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:25 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:39:25 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Acquiring lock "cinder-0d16be22-2a75-4005-9a22-93a311aaf9ba-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Lock "cinder-0d16be22-2a75-4005-9a22-93a311aaf9ba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Acquiring lock "cinder-quobyte-0d16be22-2a75-4005-9a22-93a311aaf9ba" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Lock "cinder-quobyte-0d16be22-2a75-4005-9a22-93a311aaf9ba" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf807094-c180-4dc4-964e-c6426e610eb4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:26 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba Jul 07 22:39:26 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:26 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.926s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:26 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Deleted volume successfully. Jul 07 22:39:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-17200a11-7c93-44f2-b8a7-13dabf1af081 tempest-TestStampPattern-767674385 None] Lock "cinder-6225b36f-ce4e-439d-9d40-9cde47db6ed1-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:27 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba" returned: 0 in 1.115s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:27 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba Jul 07 22:39:27 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:27 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d16be22-2a75-4005-9a22-93a311aaf9ba" returned: 0 in 0.974s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Lock "cinder-quobyte-0d16be22-2a75-4005-9a22-93a311aaf9ba" released by "delete_volume" :: held 2.151s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:28 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Created reservations ['a9ea8c40-fd7a-4d4c-ae57-1e8b0c03b848', '59375bdb-534d-4018-860e-fc2821e031e9', '1755c23f-405d-490d-90f6-85a75957a55a', '707e36de-0b30-4430-8989-83804de0fd92'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:28 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:39:28 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:29 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.985s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:29 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Deleted volume successfully. Jul 07 22:39:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4797f846-000b-40cc-9d7d-2d373114814b tempest-TestMinimumBasicScenario-1829228113 None] Lock "cinder-0d16be22-2a75-4005-9a22-93a311aaf9ba-delete_volume" released by "delete_volume" :: held 3.502s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.539s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Uploaded volume to glance image-id: 218708c4-ae87-4a43-ad93-84934e24de67. {{(pid=87612) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.493s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2107295019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b96e5f1-54a1-488f-9a18-6f967e9b9a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8406ce2b8603467aadc77dfc8d582d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:06Z,use_quota=True,user_id='cda5af8f39f744a793c6358990329021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Creating volume 1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:33 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:39:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f8563f34-7992-4340-a2b1-dbc23e1badf5 tempest-VolumesActionsTest-252134381 None] Copy volume to image completed successfully. Jul 07 22:39:33 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 1073741824 Jul 07 22:39:33 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:34 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 1073741824" returned: 0 in 1.331s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:35 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 Jul 07 22:39:35 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=46,cinder:SELECT=46,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:35 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" returned: 0 in 0.905s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.303s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=43,cinder:UPDATE=44,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec562c-117d-4ae8-a558-0fc91b50ad3e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7ac954-30a3-4bbc-87db-9aa9451a75e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75cb360-be1e-487a-998f-81172c28cea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:36 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Volume volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 (1b96e5f1-54a1-488f-9a18-6f967e9b9a04): created successfully Jul 07 22:39:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75cb360-be1e-487a-998f-81172c28cea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Flow 'volume_create_manager' (b67fadd9-38b6-4a0e-88b3-a506bda7c045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:36 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2c6cf809-ead8-4d65-a7de-6a4df0f96ae1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Created volume successfully. Jul 07 22:39:36 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:39:36 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:36 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 1.011s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d11c27-8c49-4472-8a26-d3ca443c0df9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:37 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:39:37 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:38 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 1.127s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:38 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img Jul 07 22:39:38 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img" returned: 0 in 6.764s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:44 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f76841-015a-435f-820e-d554bee00543]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:45 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:39:45 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:46 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:39:46 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 1.252s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:46 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:39:46 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Converted 1024.00 MB image at 151.34 MB/s Jul 07 22:39:46 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] 0fd5cb1e-c44f-4e49-b081-849a7baa12bf was raw, converting to qcow2 {{(pid=87612) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 22:39:46 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b68293a-2a42-45fd-98fd-00340e89691d]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:46 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img Jul 07 22:39:46 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (9fafa3dd-e482-4bec-bb16-349d7861cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35c7ff5-f1e2-496b-9884-9040fe39ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35c7ff5-f1e2-496b-9884-9040fe39ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1874948216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029faa58-7b94-4b94-a2b7-d52403f0f079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:47Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f50f16a-51d1-4039-a5a1-3549f5a6641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f50f16a-51d1-4039-a5a1-3549f5a6641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbb352e-ce7d-4e28-830c-23fce8110132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbb352e-ce7d-4e28-830c-23fce8110132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '029faa58-7b94-4b94-a2b7-d52403f0f079', 'volume_name': 'volume-029faa58-7b94-4b94-a2b7-d52403f0f079', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be3af92-be55-4d26-a45b-3c10a7f6ba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be3af92-be55-4d26-a45b-3c10a7f6ba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0d010d-68a0-43d8-9a90-2bb08d08f36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Volume 029faa58-7b94-4b94-a2b7-d52403f0f079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-029faa58-7b94-4b94-a2b7-d52403f0f079', 'volume_size': 1} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:47 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img" returned: 0 in 1.049s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:47 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img Jul 07 22:39:47 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (2efdf7df-4dd6-4dc4-ae91-04914858ed44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1979c8ce-7085-47c5-a46e-ba01fa7b2d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1979c8ce-7085-47c5-a46e-ba01fa7b2d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1236502400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98abd3b-2b1e-4861-bb09-52150a01c904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:47Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268165f9-f941-460b-850b-7baa3f0d8a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268165f9-f941-460b-850b-7baa3f0d8a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34e33aa-bc14-44db-920a-ecaf358a8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34e33aa-bc14-44db-920a-ecaf358a8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98abd3b-2b1e-4861-bb09-52150a01c904', 'volume_name': 'volume-a98abd3b-2b1e-4861-bb09-52150a01c904', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4345c491-8621-4d53-9475-fea91d8e4d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4345c491-8621-4d53-9475-fea91d8e4d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3100eb28-0976-42e7-ad3e-dd9c5b8af43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:47 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Volume a98abd3b-2b1e-4861-bb09-52150a01c904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98abd3b-2b1e-4861-bb09-52150a01c904', 'volume_size': 1} Jul 07 22:39:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (c99149bf-c30f-454d-8d90-18d25e62f240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f24b39f-17e6-4138-9d23-1a7959abdc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f24b39f-17e6-4138-9d23-1a7959abdc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567678048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cdfb2b-74f9-4d97-92c3-605d1465bcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:48Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141281dc-96b9-40bb-8e23-f992f8455f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141281dc-96b9-40bb-8e23-f992f8455f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1358cb-b2d9-40de-8049-0b32c8c7789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1358cb-b2d9-40de-8049-0b32c8c7789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1cdfb2b-74f9-4d97-92c3-605d1465bcf1', 'volume_name': 'volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29182b6-a0f4-449c-a59e-39423e845b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29182b6-a0f4-449c-a59e-39423e845b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5db602-29fb-4b6a-a2a8-ee93d76cbb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Volume e1cdfb2b-74f9-4d97-92c3-605d1465bcf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1', 'volume_size': 1} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:48 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img" returned: 1 in 1.110s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img /opt/stack/data/cinder/conversion/vol_upload_09fq0i9w {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:48 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img /opt/stack/data/cinder/conversion/vol_upload_09fq0i9w Jul 07 22:39:48 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (3109e659-8922-43c5-941e-c126a2334ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90cd58a-0912-4e97-8256-75e62e28a4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90cd58a-0912-4e97-8256-75e62e28a4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1766619842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce58af0a-2fa3-4359-bef7-ee1164e28a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:49Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f474ebc-5635-4166-a661-8712b8802a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f474ebc-5635-4166-a661-8712b8802a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602c5cdd-ebc0-47b1-b40c-928dd21c9f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602c5cdd-ebc0-47b1-b40c-928dd21c9f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce58af0a-2fa3-4359-bef7-ee1164e28a59', 'volume_name': 'volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669e74a4-2829-44f5-866e-607c24f97810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669e74a4-2829-44f5-866e-607c24f97810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37788fd1-3b57-445f-ac74-5fc2d9219e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:48 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Volume ce58af0a-2fa3-4359-bef7-ee1164e28a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59', 'volume_size': 1} Jul 07 22:39:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (b5027d56-6ab3-4f2a-9919-bb632e702433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7547005-20c7-4431-a464-c9d8d8d7dc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7547005-20c7-4431-a464-c9d8d8d7dc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-729138210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ab6371-eea0-498f-b082-4b120b2f6dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:49Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:49 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2ca2c2-55a4-4758-86e7-68ca02c0ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2ca2c2-55a4-4758-86e7-68ca02c0ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8f7703-9ab7-40b6-b75d-04bad1ad02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8f7703-9ab7-40b6-b75d-04bad1ad02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ab6371-eea0-498f-b082-4b120b2f6dfa', 'volume_name': 'volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047bfe63-e0ff-4a24-9442-4795ffd294be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047bfe63-e0ff-4a24-9442-4795ffd294be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b20e5f-10b4-4f23-9db7-27cf11f6cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:39:49 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Volume f4ab6371-eea0-498f-b082-4b120b2f6dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa', 'volume_size': 1} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img /opt/stack/data/cinder/conversion/vol_upload_09fq0i9w" returned: 0 in 0.957s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Image conversion details: src /opt/stack/data/cinder/conversion/5c44571c-0bd4-458d-a3af-82049da29cf4.temp_image.0fd5cb1e-c44f-4e49-b081-849a7baa12bfj312xroi.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_09fq0i9w {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:39:49 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fcba08-f705-4f58-bbdc-9d818c226d9d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_09fq0i9w {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:49 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_09fq0i9w Jul 07 22:39:49 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:50 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_09fq0i9w" returned: 0 in 0.864s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.200s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Uploaded volume to glance image-id: 0fd5cb1e-c44f-4e49-b081-849a7baa12bf. {{(pid=87612) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 22:39:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.606s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Creating offline snapshot 23405349-2d20-44ee-9caf-56e7ce7b53c7 of volume 1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:39:52 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c1dbd47e-f100-4cde-9757-dfcc02f55762 tempest-VolumesActionsTest-252134381 None] Copy volume to image completed successfully. Jul 07 22:39:52 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf82f181-6896-4de5-8385-7d31ea98b6e1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:52 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 Jul 07 22:39:52 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:53 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" returned: 0 in 0.983s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:53 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 1G Jul 07 22:39:53 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Acquiring lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Acquiring lock "cinder-quobyte-5c44571c-0bd4-458d-a3af-82049da29cf4" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:39:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Lock "cinder-quobyte-5c44571c-0bd4-458d-a3af-82049da29cf4" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:39:53 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f427e7e-f513-4b7b-8cac-3cb84182dfa4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:39:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:53 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:39:53 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:54 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 1G" returned: 0 in 1.097s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:54 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 Jul 07 22:39:54 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:54 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 0.953s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:54 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4 Jul 07 22:39:54 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:55 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7" returned: 0 in 0.859s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:55 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 is being set with open permissions: ugo+rw Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:55 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 Jul 07 22:39:55 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:55 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5c44571c-0bd4-458d-a3af-82049da29cf4" returned: 0 in 0.796s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Lock "cinder-quobyte-5c44571c-0bd4-458d-a3af-82049da29cf4" released by "delete_volume" :: held 1.818s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Created reservations ['c84de83b-be87-4ecb-8811-3598e76c2f87', '9fea56d4-5a7b-47fa-8ac4-537969db9090', '2b9afde7-2dd6-42bf-80de-fa8ca8a4af28', 'cc958e7b-2854-4fdf-a6a3-17ad257bcdac'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:55 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:39:55 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:55 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:39:55 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:56 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7" returned: 0 in 0.951s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:56 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.info Jul 07 22:39:56 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:56 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.112s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Deleted volume successfully. Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-496ddb75-7bc8-425a-8cbb-84f2b365c4c6 tempest-VolumesActionsTest-252134381 None] Lock "cinder-5c44571c-0bd4-458d-a3af-82049da29cf4-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:39:56 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.152s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:39:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:39:57 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.info" returned: 0 in 1.013s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:57 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.info is being set with open permissions: ugo+rw Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:57 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.info Jul 07 22:39:57 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:57 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.info" returned: 0 in 0.760s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.805s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.796s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1874948216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029faa58-7b94-4b94-a2b7-d52403f0f079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:47Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Creating volume 029faa58-7b94-4b94-a2b7-d52403f0f079 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:39:57 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:39:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:57 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 1073741824 Jul 07 22:39:57 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:57 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-96784746-38ad-49e7-b5c7-e27f5e3abf52 tempest-VolumesSnapshotListTestJSON-1926671122 None] Create snapshot completed successfully Jul 07 22:39:59 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 1073741824" returned: 0 in 1.161s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:39:59 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 Jul 07 22:39:59 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:39:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:39:59 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 07 22:39:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079" returned: 0 in 0.835s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:39:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.230s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1236502400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98abd3b-2b1e-4861-bb09-52150a01c904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:47Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Creating volume a98abd3b-2b1e-4861-bb09-52150a01c904 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:00 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0d010d-68a0-43d8-9a90-2bb08d08f36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029faa58-7b94-4b94-a2b7-d52403f0f079', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:00 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 1073741824 Jul 07 22:40:00 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2cf915-b4ea-41fa-a054-5eea17303bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:00 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Volume volume-029faa58-7b94-4b94-a2b7-d52403f0f079 (029faa58-7b94-4b94-a2b7-d52403f0f079): created successfully Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2cf915-b4ea-41fa-a054-5eea17303bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (9fafa3dd-e482-4bec-bb16-349d7861cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4fbaa17b-0298-4307-8e10-c8214c01cd5b tempest-CreateVolumesFromImageTest-874321848 None] Created volume successfully. Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Flow 'volume_create_manager' (765b4a46-8b68-449d-a5ff-b3a9ff664d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d0e902-eca8-4089-80ac-cc5631289eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d0e902-eca8-4089-80ac-cc5631289eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567e6d9b-002f-4a45-bf9e-f4da4097a8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f93782862474dcbb64460d9dbc530b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:01Z,use_quota=True,user_id='ecb77da9d0974cbfb0545f6332f28b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72bca27c-bfe2-42a7-a138-a1eb184ad029),volume_type_id=72bca27c-bfe2-42a7-a138-a1eb184ad029)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ee1f20-03ff-4fca-816a-501f13f58f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ee1f20-03ff-4fca-816a-501f13f58f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4ed0fb-262e-43b1-8f78-7a6cb2ce64b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:40:01 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 1073741824" returned: 0 in 1.219s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:01 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 Jul 07 22:40:01 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4ed0fb-262e-43b1-8f78-7a6cb2ce64b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '567e6d9b-002f-4a45-bf9e-f4da4097a8f8', 'volume_name': 'volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8', 'volume_size': 1, 'image_id': '01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61ba17b83b20980c79ebdfc6c50c6592', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f93782862474dcbb64460d9dbc530b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b47fb411a45f786d6eac5a44129da2e6b286101bacc904810f39d3a209294b772da4223c06a6e9d6da0c9c0d9fcc9d8082b4db17c6cb53d6578dad6848128c2', 'id': '01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'created_at': datetime.datetime(2026, 7, 7, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e3a1b4-8734-4945-901b-4b84e76009d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e3a1b4-8734-4945-901b-4b84e76009d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05910ac-fbbb-47a2-bacd-3dadc930cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:01 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Volume 567e6d9b-002f-4a45-bf9e-f4da4097a8f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8', 'volume_size': 1, 'image_id': '01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61ba17b83b20980c79ebdfc6c50c6592', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f93782862474dcbb64460d9dbc530b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b47fb411a45f786d6eac5a44129da2e6b286101bacc904810f39d3a209294b772da4223c06a6e9d6da0c9c0d9fcc9d8082b4db17c6cb53d6578dad6848128c2', 'id': '01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'created_at': datetime.datetime(2026, 7, 7, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Trying to clone 567e6d9b-002f-4a45-bf9e-f4da4097a8f8 from image 01ef632c-f44e-44b0-aa22-f69ef03eedc7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:40:01 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf402024-d750-4f1c-9fae-79ae42740552]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:02 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD Jul 07 22:40:02 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:02 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904" returned: 0 in 0.895s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.858s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567678048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cdfb2b-74f9-4d97-92c3-605d1465bcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:48Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Creating volume e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:02 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:02 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 1073741824 Jul 07 22:40:02 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3100eb28-0976-42e7-ad3e-dd9c5b8af43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98abd3b-2b1e-4861-bb09-52150a01c904', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8f8f52-b5ea-4811-aec1-b20710e7c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:02 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Volume volume-a98abd3b-2b1e-4861-bb09-52150a01c904 (a98abd3b-2b1e-4861-bb09-52150a01c904): created successfully Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8f8f52-b5ea-4811-aec1-b20710e7c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (2efdf7df-4dd6-4dc4-ae91-04914858ed44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d622d7f4-8536-4e2c-bc60-be52ff9ce7b3 tempest-CreateVolumesFromImageTest-874321848 None] Created volume successfully. Jul 07 22:40:03 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD" returned: 0 in 1.072s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:03 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD Jul 07 22:40:03 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:03 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 1073741824" returned: 0 in 1.098s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:03 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 Jul 07 22:40:03 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:04 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD" returned: 1 in 0.967s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Temporary image 01ef632c-f44e-44b0-aa22-f69ef03eedc7 is fetched for user ecb77da9d0974cbfb0545f6332f28b1e. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ed82a-3839-4ada-98cf-612bb18ff8db]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:04 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1" returned: 0 in 0.823s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.328s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1766619842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce58af0a-2fa3-4359-bef7-ee1164e28a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:49Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Creating volume ce58af0a-2fa3-4359-bef7-ee1164e28a59 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:04 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5db602-29fb-4b6a-a2a8-ee93d76cbb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:04 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 1073741824 Jul 07 22:40:04 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02efb908-8e4f-4f39-b1c5-7bf644f48b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Volume volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 (e1cdfb2b-74f9-4d97-92c3-605d1465bcf1): created successfully Jul 07 22:40:04 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD Jul 07 22:40:04 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02efb908-8e4f-4f39-b1c5-7bf644f48b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (c99149bf-c30f-454d-8d90-18d25e62f240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:04 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-57777ca6-a7fc-426e-ba21-f1439ae4fb1d tempest-CreateVolumesFromImageTest-874321848 None] Created volume successfully. Jul 07 22:40:05 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD" returned: 0 in 1.044s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:05 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 1073741824" returned: 0 in 1.141s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:05 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD Jul 07 22:40:05 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:05 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 Jul 07 22:40:05 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:06 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD" returned: 1 in 0.936s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:06 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59" returned: 0 in 0.805s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.846s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-729138210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ab6371-eea0-498f-b082-4b120b2f6dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022b5beedf764a87a10c472f5d78f02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:49Z,use_quota=True,user_id='1ab757f61ad345948add500206324ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Creating volume f4ab6371-eea0-498f-b082-4b120b2f6dfa {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:06 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:06 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa 1073741824 Jul 07 22:40:06 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37788fd1-3b57-445f-ac74-5fc2d9219e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88840fe-b2f9-43f5-be27-5d8d7910ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:06 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Volume volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 (ce58af0a-2fa3-4359-bef7-ee1164e28a59): created successfully Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88840fe-b2f9-43f5-be27-5d8d7910ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (3109e659-8922-43c5-941e-c126a2334ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:06 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f3861bdb-68d3-439a-adea-19199511e97e tempest-CreateVolumesFromImageTest-874321848 None] Created volume successfully. Jul 07 22:40:07 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa 1073741824" returned: 0 in 1.066s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:07 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa Jul 07 22:40:07 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:08 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa" returned: 0 in 0.801s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.907s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Creating offline snapshot 5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 of volume 1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b20e5f-10b4-4f23-9db7-27cf11f6cea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93db8d2-fdb5-48e2-a73c-44f838184ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd48f68-c7a8-46ca-8144-fc53f0f517f2]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:08 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Volume volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa (f4ab6371-eea0-498f-b082-4b120b2f6dfa): created successfully Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93db8d2-fdb5-48e2-a73c-44f838184ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Flow 'volume_create_manager' (b5027d56-6ab3-4f2a-9919-bb632e702433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3abd5503-edfe-4022-ac18-e281b2cbee6b tempest-CreateVolumesFromImageTest-874321848 None] Created volume successfully. Jul 07 22:40:08 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 Jul 07 22:40:08 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:09 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7" returned: 0 in 0.911s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:09 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 1G Jul 07 22:40:09 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-f4ab6371-eea0-498f-b082-4b120b2f6dfa-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-f4ab6371-eea0-498f-b082-4b120b2f6dfa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-quobyte-f4ab6371-eea0-498f-b082-4b120b2f6dfa" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-f4ab6371-eea0-498f-b082-4b120b2f6dfa" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4340b1-4525-4808-a773-37e020adf636]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:09 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa Jul 07 22:40:09 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:10 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 1G" returned: 0 in 1.426s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:10 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 Jul 07 22:40:10 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:10 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa" returned: 0 in 1.026s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:10 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa Jul 07 22:40:10 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:11 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" returned: 0 in 0.915s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:11 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 is being set with open permissions: ugo+rw Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:11 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f4ab6371-eea0-498f-b082-4b120b2f6dfa" returned: 0 in 0.871s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:11 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 Jul 07 22:40:11 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-f4ab6371-eea0-498f-b082-4b120b2f6dfa" released by "delete_volume" :: held 2.066s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Created reservations ['28185b1d-1933-48df-9661-771bb5650211', 'e4ac68ff-b345-4aed-b935-cc873f4fd9c0', 'a24cf071-639e-4fcb-b59e-b6a6d01c4bdc', 'a2b68e50-7a64-4b1e-be4b-dc90bb8642fa'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:11 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:11 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:12 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.252s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.289s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567e6d9b-002f-4a45-bf9e-f4da4097a8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f93782862474dcbb64460d9dbc530b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:01Z,use_quota=True,user_id='ecb77da9d0974cbfb0545f6332f28b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72bca27c-bfe2-42a7-a138-a1eb184ad029),volume_type_id=72bca27c-bfe2-42a7-a138-a1eb184ad029)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Creating volume 567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:12 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:12 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 1073741824 Jul 07 22:40:12 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-bfa0fd28-047e-40c0-835e-6e5e1b39e83a tempest-VolumesSnapshotListTestJSON-1926671122 None] Create snapshot completed successfully Jul 07 22:40:12 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.855s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Deleted volume successfully. Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-592c2d5f-6851-4f1b-ae94-8448a94c8bf5 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-f4ab6371-eea0-498f-b082-4b120b2f6dfa-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-ce58af0a-2fa3-4359-bef7-ee1164e28a59-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-ce58af0a-2fa3-4359-bef7-ee1164e28a59-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-quobyte-ce58af0a-2fa3-4359-bef7-ee1164e28a59" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-ce58af0a-2fa3-4359-bef7-ee1164e28a59" acquired by "delete_volume" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdf9238-15bd-4406-bbf8-c0c9c6dc16bc]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:13 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 Jul 07 22:40:13 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:13 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 1073741824" returned: 0 in 1.324s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:13 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 Jul 07 22:40:13 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:14 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59" returned: 0 in 1.032s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:14 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59 Jul 07 22:40:14 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:14 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" returned: 0 in 0.927s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.394s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Creating offline snapshot 737de9b7-0576-445a-8e0e-1c9fa2357c2e of volume 1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:40:14 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ce58af0a-2fa3-4359-bef7-ee1164e28a59" returned: 0 in 0.819s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Attempting download of 01ef632c-f44e-44b0-aa22-f69ef03eedc7 ((None, [{'url': 'file:///opt/stack/data/glance/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'metadata': {}}])) to volume 567e6d9b-002f-4a45-bf9e-f4da4097a8f8. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-ce58af0a-2fa3-4359-bef7-ee1164e28a59" released by "delete_volume" :: held 1.934s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e63ef-10d1-46d4-b87b-6b773a72c64d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b55df4c-30de-42a5-a345-b236d0e2103d]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01ef632c-f44e-44b0-aa22-f69ef03eedc7_hug0samc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:14 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Created reservations ['4bdc57c0-24f7-4e06-a866-cd9ba7540ff0', 'ab2d4508-363a-4c1d-bc68-05c12d78d2c1', 'ff32370a-462a-4702-a796-aff700587949', '7db715a8-427e-4779-8e89-1ed05ff2aade'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:15 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 Jul 07 22:40:15 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:15 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01ef632c-f44e-44b0-aa22-f69ef03eedc7_hug0samc Jul 07 22:40:15 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:15 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:15 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:16 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" returned: 0 in 1.299s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:16 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01ef632c-f44e-44b0-aa22-f69ef03eedc7_hug0samc" returned: 0 in 1.305s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:16 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01ef632c-f44e-44b0-aa22-f69ef03eedc7_hug0samc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:16 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e 1G Jul 07 22:40:16 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.117s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:16 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Deleted volume successfully. Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-373d795f-fd4a-472a-9e80-77cb6bc37d2d tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-ce58af0a-2fa3-4359-bef7-ee1164e28a59-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:16 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01ef632c-f44e-44b0-aa22-f69ef03eedc7_hug0samc Jul 07 22:40:16 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-quobyte-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c23fb-025d-4488-89cb-d97ff3d8ccaa]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:16 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 Jul 07 22:40:16 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:17 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01ef632c-f44e-44b0-aa22-f69ef03eedc7_hug0samc" returned: 1 in 1.124s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01ef632c-f44e-44b0-aa22-f69ef03eedc7_hug0samc' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:40:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92fef32-1723-49fb-952a-099d60e305a4]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:17 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD Jul 07 22:40:17 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:17 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e 1G" returned: 0 in 1.625s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:17 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e Jul 07 22:40:17 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:17 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1" returned: 0 in 1.412s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:18 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1 Jul 07 22:40:18 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:18 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD" returned: 0 in 0.985s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:18 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD Jul 07 22:40:18 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:18 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e" returned: 0 in 0.985s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:18 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e is being set with open permissions: ugo+rw Jul 07 22:40:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:18 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e Jul 07 22:40:18 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:18 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1" returned: 0 in 0.919s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1" released by "delete_volume" :: held 2.425s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:18 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Created reservations ['c3f0e3a3-50c3-4a30-af8f-d48a16a8cb1c', 'bcdfd3ed-69ec-4ff5-a4d4-87ad40aa4f36', '00ae6595-a83b-4a01-b3cf-3ddbc8fa247f', '8d54d23e-c1ce-4f4c-9d5d-3a987340901c'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:19 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:19 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:19 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD" returned: 1 in 1.037s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] 01ef632c-f44e-44b0-aa22-f69ef03eedc7 was raw, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:19 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 Jul 07 22:40:19 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (a3993e60-14fe-43a9-8ac1-c4fd23511741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097c9b54-b19c-4c99-9617-3cd91ab4f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097c9b54-b19c-4c99-9617-3cd91ab4f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-95251632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c304d0-3bca-41af-80ed-64014e8ba024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963e10a8fd4344fbb70f131329c4b6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:19Z,use_quota=True,user_id='ba3362ffbba645e59d8b440bf1257299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24bc3c2-2f52-465a-9928-08c06319d574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24bc3c2-2f52-465a-9928-08c06319d574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fadeef0-f636-4736-aea8-98b7f9c27b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fadeef0-f636-4736-aea8-98b7f9c27b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c304d0-3bca-41af-80ed-64014e8ba024', 'volume_name': 'volume-77c304d0-3bca-41af-80ed-64014e8ba024', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fd09a0-9f2a-46db-b26e-377d9e752660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fd09a0-9f2a-46db-b26e-377d9e752660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af94d676-8004-410c-a4ea-12bfb79a29d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:19 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume 77c304d0-3bca-41af-80ed-64014e8ba024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c304d0-3bca-41af-80ed-64014e8ba024', 'volume_size': 1} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-a98abd3b-2b1e-4861-bb09-52150a01c904-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-a98abd3b-2b1e-4861-bb09-52150a01c904-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-quobyte-a98abd3b-2b1e-4861-bb09-52150a01c904" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-a98abd3b-2b1e-4861-bb09-52150a01c904" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:19 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e" returned: 0 in 1.116s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d95d41e-216a-47db-a905-508ff92475de]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.204s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-95251632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c304d0-3bca-41af-80ed-64014e8ba024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963e10a8fd4344fbb70f131329c4b6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:19Z,use_quota=True,user_id='ba3362ffbba645e59d8b440bf1257299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Creating volume 77c304d0-3bca-41af-80ed-64014e8ba024 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:19 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:20 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 1073741824 Jul 07 22:40:20 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:20 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5a37baf2-08d1-45c5-9306-72f27d45b7f1 tempest-VolumesSnapshotListTestJSON-1926671122 None] Create snapshot completed successfully Jul 07 22:40:20 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 Jul 07 22:40:20 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:20 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.018s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:20 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:20 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Deleted volume successfully. Jul 07 22:40:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9813641c-6bb6-4f82-96e6-58f3bb9a985b tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-e1cdfb2b-74f9-4d97-92c3-605d1465bcf1-delete_volume" released by "delete_volume" :: held 3.802s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:20 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" returned: 0 in 0.991s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:20 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_01ef632c-f44e-44b0-aa22-f69ef03eedc7_mzkvvizidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:40:20 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:40:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:20 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 1G Jul 07 22:40:20 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:20 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904" returned: 0 in 1.023s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:20 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904 Jul 07 22:40:20 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:21 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 1073741824" returned: 0 in 1.190s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:21 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 1G" returned: 0 in 0.878s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:21 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 Jul 07 22:40:21 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:21 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf67a895-fe05-4658-a99c-840c4a727f8d]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:21 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 Jul 07 22:40:21 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:21 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a98abd3b-2b1e-4861-bb09-52150a01c904" returned: 0 in 0.948s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-a98abd3b-2b1e-4861-bb09-52150a01c904" released by "delete_volume" :: held 2.035s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Created reservations ['2edf6493-4bb1-4ad9-8ef5-7b9d5323adca', '05fc3289-c2e2-4151-99e7-38ddef3e5c28', '8d963e1d-a742-40f3-aff3-4a852bd6d484', '8dc3a5c3-070f-454d-a4b6-329cbb5308c4'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:22 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024" returned: 0 in 0.930s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af94d676-8004-410c-a4ea-12bfb79a29d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c304d0-3bca-41af-80ed-64014e8ba024', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c612c6-15cc-47c6-b9d0-3b4f638e4d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume volume-77c304d0-3bca-41af-80ed-64014e8ba024 (77c304d0-3bca-41af-80ed-64014e8ba024): created successfully Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c612c6-15cc-47c6-b9d0-3b4f638e4d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (a3993e60-14fe-43a9-8ac1-c4fd23511741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-737de9b7-0576-445a-8e0e-1c9fa2357c2e-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-bb22f17f-a527-4358-a6f1-ace9679dbd03 tempest-VolumesSnapshotTestJSON-1005451233 None] Created volume successfully. Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-737de9b7-0576-445a-8e0e-1c9fa2357c2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-quobyte-737de9b7-0576-445a-8e0e-1c9fa2357c2e" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-737de9b7-0576-445a-8e0e-1c9fa2357c2e" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Deleting offline snapshot 737de9b7-0576-445a-8e0e-1c9fa2357c2e of volume 1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:40:22 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:22 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] snapshot_file for this snap is: volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07beaec-a1af-4f33-94f3-1a231cc02a56]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:22 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" returned: 0 in 1.158s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:22 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e Jul 07 22:40:22 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:22 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 Jul 07 22:40:22 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Creating offline snapshot ed646f98-c524-4263-bd12-813e4beae8d3 of volume 77c304d0-3bca-41af-80ed-64014e8ba024 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1429a0b2-4917-424d-94e3-037228a6a55d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:23 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 Jul 07 22:40:23 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:23 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-029faa58-7b94-4b94-a2b7-d52403f0f079-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.963s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Deleted volume successfully. Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-029faa58-7b94-4b94-a2b7-d52403f0f079-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cd04ab39-9851-41d5-bda7-6cf60fca7c35 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-a98abd3b-2b1e-4861-bb09-52150a01c904-delete_volume" released by "delete_volume" :: held 3.627s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "cinder-quobyte-029faa58-7b94-4b94-a2b7-d52403f0f079" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-029faa58-7b94-4b94-a2b7-d52403f0f079" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2108485b-5222-4555-8f0f-1a166621b24b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:23 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e" returned: 0 in 1.118s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[68da1119-8442-405c-a176-be484dc99ca5]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:23 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" returned: 1 in 1.196s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Downloaded image 01ef632c-f44e-44b0-aa22-f69ef03eedc7 ((None, [{'url': 'file:///opt/stack/data/glance/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'metadata': {}}])) to volume 567e6d9b-002f-4a45-bf9e-f4da4097a8f8 successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Temporary image 01ef632c-f44e-44b0-aa22-f69ef03eedc7 for user ecb77da9d0974cbfb0545f6332f28b1e is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Marking volume 567e6d9b-002f-4a45-bf9e-f4da4097a8f8 as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:40:23 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 Jul 07 22:40:23 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Copying metadata from image 01ef632c-f44e-44b0-aa22-f69ef03eedc7 to 567e6d9b-002f-4a45-bf9e-f4da4097a8f8. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Creating volume glance metadata for volume 567e6d9b-002f-4a45-bf9e-f4da4097a8f8 backed by image 01ef632c-f44e-44b0-aa22-f69ef03eedc7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '61ba17b83b20980c79ebdfc6c50c6592', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:40:23 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 Jul 07 22:40:23 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05910ac-fbbb-47a2-bacd-3dadc930cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8', 'volume_size': 1, 'image_id': '01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61ba17b83b20980c79ebdfc6c50c6592', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f93782862474dcbb64460d9dbc530b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b47fb411a45f786d6eac5a44129da2e6b286101bacc904810f39d3a209294b772da4223c06a6e9d6da0c9c0d9fcc9d8082b4db17c6cb53d6578dad6848128c2', 'id': '01ef632c-f44e-44b0-aa22-f69ef03eedc7', 'created_at': datetime.datetime(2026, 7, 7, 20, 39, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01ef632c-f44e-44b0-aa22-f69ef03eedc7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e51a9f-2fa5-477b-97ca-a6f074cf429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:23 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Volume volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 (567e6d9b-002f-4a45-bf9e-f4da4097a8f8): created successfully Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e51a9f-2fa5-477b-97ca-a6f074cf429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Flow 'volume_create_manager' (765b4a46-8b68-449d-a5ff-b3a9ff664d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2ec9191e-4b91-4a0a-9e26-0efc4ec5d860 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Created volume successfully. Jul 07 22:40:24 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024" returned: 0 in 1.065s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:24 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 1G Jul 07 22:40:24 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Acquiring lock "cinder-567e6d9b-002f-4a45-bf9e-f4da4097a8f8-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "cinder-567e6d9b-002f-4a45-bf9e-f4da4097a8f8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Acquiring lock "cinder-quobyte-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "cinder-quobyte-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:24 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079" returned: 0 in 1.047s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1474fd8-4dac-4210-8a51-40dcc32469ba]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:24 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079 Jul 07 22:40:24 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:24 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" returned: 0 in 1.092s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:24 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 Jul 07 22:40:24 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:24 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e Jul 07 22:40:24 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:25 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 1G" returned: 0 in 1.099s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c304d0-3bca-41af-80ed-64014e8ba024 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:25 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c304d0-3bca-41af-80ed-64014e8ba024 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 Jul 07 22:40:25 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:25 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-029faa58-7b94-4b94-a2b7-d52403f0f079" returned: 0 in 0.850s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-quobyte-029faa58-7b94-4b94-a2b7-d52403f0f079" released by "delete_volume" :: held 1.952s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Created reservations ['c5e34aa1-ac40-438f-acc0-8b15c8a8d317', '3e559b87-08c3-4f1c-bc43-d746acc5740c', 'cef19935-699b-4c1c-bce0-029ff1527dab', 'aee4c147-c463-4052-a80a-8f8ece73cf23'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:25 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:25 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:25 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" returned: 0 in 1.125s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:25 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e" returned: 0 in 1.036s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:25 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e Jul 07 22:40:25 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:25 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 Jul 07 22:40:25 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:26 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c304d0-3bca-41af-80ed-64014e8ba024 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3" returned: 0 in 0.990s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:26 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 is being set with open permissions: ugo+rw Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:26 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 Jul 07 22:40:26 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:26 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.844s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Deleted volume successfully. Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-66b02337-fb29-47f8-acc4-db07ac8c5152 tempest-CreateVolumesFromImageTest-874321848 None] Lock "cinder-029faa58-7b94-4b94-a2b7-d52403f0f079-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:26 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.737de9b7-0576-445a-8e0e-1c9fa2357c2e" returned: 0 in 0.899s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-737de9b7-0576-445a-8e0e-1c9fa2357c2e" released by "_delete_snapshot" :: held 4.318s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" released by "delete_snapshot" :: held 4.374s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Created reservations ['7090fe5f-bee5-458c-a85d-e378e361a579', '589dbe9e-d10f-4b93-9587-10de1e49a055', 'bedd285c-4aa6-47f6-9848-91e6cf3720e2', 'e26fe0a4-4c9f-47e7-a2c1-7f83f0a9d74f'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Delete snapshot completed successfully. Jul 07 22:40:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7e9e828c-04a9-4a69-b0e0-34afb4b8a7a0 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-737de9b7-0576-445a-8e0e-1c9fa2357c2e-delete_snapshot" released by "delete_snapshot" :: held 4.617s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:27 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" returned: 1 in 1.309s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:27 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8 Jul 07 22:40:27 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:27 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3" returned: 0 in 0.966s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:27 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.info Jul 07 22:40:27 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-5f15017d-1ae1-4223-8a5c-9e0f0e3ced63-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-5f15017d-1ae1-4223-8a5c-9e0f0e3ced63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-quobyte-5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Deleting offline snapshot 5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 of volume 1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] snapshot_file for this snap is: volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b44cbd5-6e62-4017-9750-70659160583d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:27 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" returned: 0 in 0.892s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "cinder-quobyte-567e6d9b-002f-4a45-bf9e-f4da4097a8f8" released by "delete_volume" :: held 3.426s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:27 devstack cinder-volume[87612]: WARNING cinder.quota [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:40:27 devstack cinder-volume[87612]: WARNING cinder.quota [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Created reservations ['1ba4c73c-eeeb-4880-9b76-b315486dedb6', '25e75ab9-96b3-4371-99bb-41d88a1bebf0', '937ac176-64a7-4a31-a2e0-ab0ef76fd59f', '0c11784a-129d-403e-a765-bfdc6bb73a00'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:28 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 Jul 07 22:40:28 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:28 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.info" returned: 0 in 0.915s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:28 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.info is being set with open permissions: ugo+rw Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:28 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.info Jul 07 22:40:28 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:28 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:28 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:29 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" returned: 0 in 1.170s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811d224-46d7-47f8-9012-61b1e7d347ee]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:29 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.info" returned: 0 in 1.055s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:29 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.217s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.995s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Deleted volume successfully. Jul 07 22:40:29 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 Jul 07 22:40:29 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-22bd4a0a-4340-453a-9413-b6af380c0a85 tempest-VolumeAndVolumeTypeFromImageTest-377548353 None] Lock "cinder-567e6d9b-002f-4a45-bf9e-f4da4097a8f8-delete_volume" released by "delete_volume" :: held 4.843s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ea9e60b6-cb0f-45cc-896f-7ca4b1cbd0cd tempest-VolumesSnapshotTestJSON-1005451233 None] Create snapshot completed successfully Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Flow 'volume_create_manager' (ed58c108-08f0-49bc-9da6-53875def57dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba08a9ae-98c3-4642-bd18-f3f73bf02f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba08a9ae-98c3-4642-bd18-f3f73bf02f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1888382035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d28c0c9-6cd7-4be9-bfe3-e8855487dd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ae7b83747f46e3ae45a2658da276b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:30Z,use_quota=True,user_id='f3bc9ee4f7c84d76b1a78210d20133fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463f38e0-c098-450b-9315-20120db60fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463f38e0-c098-450b-9315-20120db60fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532b5fb2-0e43-4c2e-a4c2-011d31932b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532b5fb2-0e43-4c2e-a4c2-011d31932b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d28c0c9-6cd7-4be9-bfe3-e8855487dd75', 'volume_name': 'volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae30d1e-cebc-4c5d-976a-8b85e25a2fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae30d1e-cebc-4c5d-976a-8b85e25a2fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:30 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41f05c8-034c-4fbb-982d-74f6db9b1aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Volume 3d28c0c9-6cd7-4be9-bfe3-e8855487dd75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75', 'volume_size': 1} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1888382035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d28c0c9-6cd7-4be9-bfe3-e8855487dd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ae7b83747f46e3ae45a2658da276b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:30Z,use_quota=True,user_id='f3bc9ee4f7c84d76b1a78210d20133fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Creating volume 3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:30 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7" returned: 0 in 1.097s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:30 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 1073741824 Jul 07 22:40:30 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:30 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 Jul 07 22:40:30 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-ed646f98-c524-4263-bd12-813e4beae8d3-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-ed646f98-c524-4263-bd12-813e4beae8d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-77c304d0-3bca-41af-80ed-64014e8ba024" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-77c304d0-3bca-41af-80ed-64014e8ba024" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-ed646f98-c524-4263-bd12-813e4beae8d3" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-ed646f98-c524-4263-bd12-813e4beae8d3" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Deleting offline snapshot ed646f98-c524-4263-bd12-813e4beae8d3 of volume 77c304d0-3bca-41af-80ed-64014e8ba024 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] snapshot_file for this snap is: volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67745bd-604b-4a68-bb91-4101e3783c15]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:30 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 Jul 07 22:40:30 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:31 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" returned: 0 in 1.074s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:31 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63 Jul 07 22:40:31 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:31 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 1073741824" returned: 0 in 1.186s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:31 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 Jul 07 22:40:31 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:32 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3" returned: 0 in 1.255s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77c304d0-3bca-41af-80ed-64014e8ba024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[917165c1-ad49-4784-8dc6-be424ec9febf]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:32 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 Jul 07 22:40:32 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:32 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" returned: 0 in 1.021s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-5f15017d-1ae1-4223-8a5c-9e0f0e3ced63" released by "_delete_snapshot" :: held 4.547s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" released by "delete_snapshot" :: held 4.584s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Created reservations ['abc79318-c166-4cde-9c73-e60ed5f6d22c', '07317087-5edc-4e05-94dd-60e46047013a', '38612ef9-72e0-41ed-b1eb-27da519d9223', '3c93a804-2c26-45ac-846f-ecb5b1704431'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:32 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Delete snapshot completed successfully. Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f1f2514b-59df-4634-83f7-0252093bdaab tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-5f15017d-1ae1-4223-8a5c-9e0f0e3ced63-delete_snapshot" released by "delete_snapshot" :: held 4.897s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:32 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" returned: 0 in 0.994s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] <== create_volume: return (2464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41f05c8-034c-4fbb-982d-74f6db9b1aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb852c6-dcc5-4b3c-a254-d24426a02908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:32 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Volume volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 (3d28c0c9-6cd7-4be9-bfe3-e8855487dd75): created successfully Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb852c6-dcc5-4b3c-a254-d24426a02908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Flow 'volume_create_manager' (ed58c108-08f0-49bc-9da6-53875def57dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:32 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a347cc72-515f-45ee-8f5b-71aa11912ac9 tempest-VolumeDependencyTests-361558233 None] Created volume successfully. Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-23405349-2d20-44ee-9caf-56e7ce7b53c7-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-23405349-2d20-44ee-9caf-56e7ce7b53c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:33 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024" returned: 0 in 1.163s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-quobyte-23405349-2d20-44ee-9caf-56e7ce7b53c7" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:33 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-23405349-2d20-44ee-9caf-56e7ce7b53c7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:33 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Deleting offline snapshot 23405349-2d20-44ee-9caf-56e7ce7b53c7 of volume 1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] snapshot_file for this snap is: volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf59fee-014f-46ce-a93b-4db49132e351]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:33 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 Jul 07 22:40:33 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Creating offline snapshot 9f165e36-d509-467f-afc1-be5307e43f3a of volume 3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cb3985-e641-4285-83d5-a84669df06a2]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:34 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 Jul 07 22:40:34 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:34 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3" returned: 0 in 1.059s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:34 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7" returned: 0 in 0.988s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:34 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3 Jul 07 22:40:34 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:34 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1794a02-77a8-4b21-8815-4a728cf88ac5]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:34 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 Jul 07 22:40:34 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:34 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" returned: 0 in 1.074s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:35 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a 1G Jul 07 22:40:35 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:35 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024.ed646f98-c524-4263-bd12-813e4beae8d3" returned: 0 in 0.846s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-ed646f98-c524-4263-bd12-813e4beae8d3" released by "_delete_snapshot" :: held 4.498s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-77c304d0-3bca-41af-80ed-64014e8ba024" released by "delete_snapshot" :: held 4.554s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:35 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Created reservations ['349bd5ae-beba-49a3-a05a-1bc564345b13', '6ddfeeaf-1340-4c9a-9023-abd7e730601a', '02253ed1-5ebf-4aac-bc67-26ae54fd05ed', 'b5dd9453-2cb2-403c-9c33-85cbed9a3831'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:35 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" returned: 0 in 0.970s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:35 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 Jul 07 22:40:35 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:35 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Delete snapshot completed successfully. Jul 07 22:40:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-69936111-9d0d-4b64-84b6-996355465bb3 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-ed646f98-c524-4263-bd12-813e4beae8d3-delete_snapshot" released by "delete_snapshot" :: held 4.903s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:36 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a 1G" returned: 0 in 1.130s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:36 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a Jul 07 22:40:36 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:36 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7" returned: 0 in 1.039s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:36 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7 Jul 07 22:40:36 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:DELETE=8,cinder:SELECT=90,cinder:UPDATE=97,cinder:INSERT=31 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (fcb529f1-a8b7-4073-8959-a56656c6a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbf11eb-6501-4baf-93ae-816a6ac33e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbf11eb-6501-4baf-93ae-816a6ac33e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-952275268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619d4544-2d51-4732-879e-a92972ce4e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963e10a8fd4344fbb70f131329c4b6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:37Z,use_quota=True,user_id='ba3362ffbba645e59d8b440bf1257299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530e2d68-edd6-4dac-8b65-55f5f0270d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530e2d68-edd6-4dac-8b65-55f5f0270d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4cb19b-43cf-4656-b194-d4f616d9154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4cb19b-43cf-4656-b194-d4f616d9154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619d4544-2d51-4732-879e-a92972ce4e0e', 'volume_name': 'volume-619d4544-2d51-4732-879e-a92972ce4e0e', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a97696-2c3b-4f17-80fe-25d3c7af60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a97696-2c3b-4f17-80fe-25d3c7af60d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0459ca5b-f07a-4bdf-9945-5769ffa7b987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:36 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume 619d4544-2d51-4732-879e-a92972ce4e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619d4544-2d51-4732-879e-a92972ce4e0e', 'volume_size': 1} Jul 07 22:40:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:37 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a" returned: 0 in 0.994s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:37 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a is being set with open permissions: ugo+rw Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:37 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a Jul 07 22:40:37 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:37 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04.23405349-2d20-44ee-9caf-56e7ce7b53c7" returned: 0 in 0.897s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-23405349-2d20-44ee-9caf-56e7ce7b53c7" released by "_delete_snapshot" :: held 4.068s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" released by "delete_snapshot" :: held 4.105s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Created reservations ['01de1b03-c3bd-492d-940b-b53961385f6f', '1cb8239b-37d0-4a0b-9054-dc671a63f9f8', '12d90a33-4729-4caa-9d81-122f6275d3f7', '4816797f-5270-4414-8362-d62441d572cd'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Delete snapshot completed successfully. Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-55054bb5-05a5-4714-8089-0a62af31c2dc tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-23405349-2d20-44ee-9caf-56e7ce7b53c7-delete_snapshot" released by "delete_snapshot" :: held 4.343s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:37 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a" returned: 0 in 0.798s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:37 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.info Jul 07 22:40:37 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:38 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.info" returned: 0 in 0.691s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:38 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.info is being set with open permissions: ugo+rw Jul 07 22:40:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:38 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.info Jul 07 22:40:38 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-1b96e5f1-54a1-488f-9a18-6f967e9b9a04-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-1b96e5f1-54a1-488f-9a18-6f967e9b9a04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:38 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e988869-6d9b-4fa9-813e-af48b40dba75]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:39 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 Jul 07 22:40:39 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:39 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.info" returned: 0 in 0.884s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.686s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-952275268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619d4544-2d51-4732-879e-a92972ce4e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963e10a8fd4344fbb70f131329c4b6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:37Z,use_quota=True,user_id='ba3362ffbba645e59d8b440bf1257299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Creating volume 619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:39 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:39 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e 1073741824 Jul 07 22:40:39 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ee501c25-d76a-4136-a64b-0b6bf2bc8171 tempest-VolumeDependencyTests-361558233 None] Create snapshot completed successfully Jul 07 22:40:39 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" returned: 0 in 0.897s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:39 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04 Jul 07 22:40:39 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:40 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" returned: 0 in 0.807s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-quobyte-1b96e5f1-54a1-488f-9a18-6f967e9b9a04" released by "delete_volume" :: held 1.790s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:40 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e 1073741824" returned: 0 in 1.074s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Created reservations ['efb261af-d70f-4703-9bbb-541967767dc8', 'a65c2a5b-8f67-4426-997c-edd1e62bacc2', '09af55ba-e996-4175-aafa-b73a0b563786', 'dfb28039-737b-4297-a02a-da444ba4cc7d'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:40 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e Jul 07 22:40:40 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:40 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:40 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:40 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Flow 'volume_create_manager' (1d5c162f-ac66-4fc7-83e9-b82b04d38ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba22e31-238a-4f58-8c2a-ca6b4afa2a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba22e31-238a-4f58-8c2a-ca6b4afa2a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1751829869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d754ed4-c72b-4e1e-8bc7-ff4782c5c803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ae7b83747f46e3ae45a2658da276b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f165e36-d509-467f-afc1-be5307e43f3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:41Z,use_quota=True,user_id='f3bc9ee4f7c84d76b1a78210d20133fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34cebfd-be39-4da0-9d0d-4b4e80bc8f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34cebfd-be39-4da0-9d0d-4b4e80bc8f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2958283f-6264-4799-85da-e598aa337bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2958283f-6264-4799-85da-e598aa337bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d754ed4-c72b-4e1e-8bc7-ff4782c5c803', 'volume_name': 'volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803', 'volume_size': 1, 'snapshot_id': '9f165e36-d509-467f-afc1-be5307e43f3a'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6c8178-7e9f-4a0f-8178-6a17e24f2368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6c8178-7e9f-4a0f-8178-6a17e24f2368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed1eae1-c619-47c9-b9db-33d1cd4b80c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:41 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Volume 2d754ed4-c72b-4e1e-8bc7-ff4782c5c803: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803', 'volume_size': 1, 'snapshot_id': '9f165e36-d509-467f-afc1-be5307e43f3a'} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:41 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e" returned: 0 in 0.863s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.375s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-quobyte-9f165e36-d509-467f-afc1-be5307e43f3a-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0459ca5b-f07a-4bdf-9945-5769ffa7b987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619d4544-2d51-4732-879e-a92972ce4e0e', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab28ec25-85f2-40af-8c8d-4df9418d77e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:41 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume volume-619d4544-2d51-4732-879e-a92972ce4e0e (619d4544-2d51-4732-879e-a92972ce4e0e): created successfully Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab28ec25-85f2-40af-8c8d-4df9418d77e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (fcb529f1-a8b7-4073-8959-a56656c6a516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-9f165e36-d509-467f-afc1-be5307e43f3a-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" acquired by "_create_volume_from_snapshot" :: waited 0.092s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Creating volume 2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 from snapshot 9f165e36-d509-467f-afc1-be5307e43f3a {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-quobyte-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] snapshot: 9f165e36-d509-467f-afc1-be5307e43f3a, volume: 2d754ed4-c72b-4e1e-8bc7-ff4782c5c803, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:40:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4f390dcc-36a1-4fe3-9ee5-ba4104e5b811 tempest-VolumesSnapshotTestJSON-1005451233 None] Created volume successfully. Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:41 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.941s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Deleted volume successfully. Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[be48c929-d713-4566-b220-caef015cf924]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e6d24660-7b23-486c-902f-c2baa14fbfb4 tempest-VolumesSnapshotListTestJSON-1926671122 None] Lock "cinder-1b96e5f1-54a1-488f-9a18-6f967e9b9a04-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:42 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a Jul 07 22:40:42 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:43 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a" returned: 0 in 1.250s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:40:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:40:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81ce313-e592-425b-9339-279184b3cbad]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:43 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 Jul 07 22:40:43 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:44 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" returned: 0 in 0.974s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:44 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:40:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:44 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 Jul 07 22:40:44 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:45 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (a2e4dc4a-3aa9-436c-86db-d990aebc5c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4487bb9c-4558-4741-85fb-8d4b3dd3de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4487bb9c-4558-4741-85fb-8d4b3dd3de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816270565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bf1087-0ab5-4eb5-b919-732ed6522086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:46Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6256a9b-31c1-414f-bf6e-3b6e4a1c5d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6256a9b-31c1-414f-bf6e-3b6e4a1c5d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6382dee7-02ca-4084-ad3a-77ec2db69461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6382dee7-02ca-4084-ad3a-77ec2db69461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65bf1087-0ab5-4eb5-b919-732ed6522086', 'volume_name': 'volume-65bf1087-0ab5-4eb5-b919-732ed6522086', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3005575f-a8b4-4fa4-82bb-48d201aaeade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3005575f-a8b4-4fa4-82bb-48d201aaeade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acff2514-b3b6-40e5-a46d-1a9f0912bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:46 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume 65bf1087-0ab5-4eb5-b919-732ed6522086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65bf1087-0ab5-4eb5-b919-732ed6522086', 'volume_size': 1} Jul 07 22:40:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:50 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" returned: 0 in 6.417s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:50 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0854c0e-b062-44d4-89d1-a5acf7ea7d63]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:50 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 Jul 07 22:40:50 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:51 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" returned: 0 in 1.062s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:51 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:40:51 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Converted 1024.00 MB image at 159.56 MB/s Jul 07 22:40:51 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 is being set with open permissions: ugo+rw Jul 07 22:40:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:51 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 Jul 07 22:40:51 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Flow 'volume_create_manager' (f0eb6562-65a7-4045-b156-e01a35ef6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0c7958-68df-41cd-bd2d-bd60cf16a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=109,cinder:UPDATE=134,cinder:INSERT=34,cinder:DELETE=13 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0c7958-68df-41cd-bd2d-bd60cf16a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-469742549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71954e5-442d-4fee-b15c-c4d5b01d462b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f9c52557ca4d9fb7104ed08ce0a04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:52Z,use_quota=True,user_id='b8d0f664b04d456e9458da8e4a28146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7bcfe2-bde1-4904-9575-1d7da15db32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7bcfe2-bde1-4904-9575-1d7da15db32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be0db37-abec-4be1-af50-ec55daed7163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be0db37-abec-4be1-af50-ec55daed7163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71954e5-442d-4fee-b15c-c4d5b01d462b', 'volume_name': 'volume-b71954e5-442d-4fee-b15c-c4d5b01d462b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87320fc-a1b8-460b-9bdb-8b7522e69b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87320fc-a1b8-460b-9bdb-8b7522e69b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fdb67b-2c03-49ec-9fc1-745451f81542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:52 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Volume b71954e5-442d-4fee-b15c-c4d5b01d462b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71954e5-442d-4fee-b15c-c4d5b01d462b', 'volume_size': 1} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:52 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" returned: 0 in 0.807s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" released by "_copy_volume_from_snapshot" :: held 10.699s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-9f165e36-d509-467f-afc1-be5307e43f3a-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" released by "_create_volume_from_snapshot" :: held 10.755s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.851s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.727s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Creating offline snapshot 43a95522-85e4-4b57-8337-6058e64584fd of volume 619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed1eae1-c619-47c9-b9db-33d1cd4b80c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803', 'volume_size': 1, 'snapshot_id': '9f165e36-d509-467f-afc1-be5307e43f3a'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f44c21-3c56-45a7-904f-c3feb3adc83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fc5dd6-8cc5-4f71-9111-bb57fa4784f8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:52 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Volume volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 (2d754ed4-c72b-4e1e-8bc7-ff4782c5c803): created successfully Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f44c21-3c56-45a7-904f-c3feb3adc83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Flow 'volume_create_manager' (1d5c162f-ac66-4fc7-83e9-b82b04d38ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:52 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9116a5fc-0509-43e5-afe1-1470d4f29177 tempest-VolumeDependencyTests-361558233 None] Created volume successfully. Jul 07 22:40:52 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e Jul 07 22:40:52 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-9f165e36-d509-467f-afc1-be5307e43f3a-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Lock "cinder-9f165e36-d509-467f-afc1-be5307e43f3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-quobyte-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-quobyte-9f165e36-d509-467f-afc1-be5307e43f3a" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-9f165e36-d509-467f-afc1-be5307e43f3a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Deleting offline snapshot 9f165e36-d509-467f-afc1-be5307e43f3a of volume 3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] snapshot_file for this snap is: volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9845c2f6-22b9-42fc-83cc-d987bc4e2b26]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:53 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e" returned: 0 in 0.878s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:53 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd 1G Jul 07 22:40:53 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:53 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a Jul 07 22:40:53 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:54 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a" returned: 0 in 0.889s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:40:54 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3674b78f-3a79-4f53-9586-62786ab42b0d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:54 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd 1G" returned: 0 in 0.952s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619d4544-2d51-4732-879e-a92972ce4e0e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:54 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619d4544-2d51-4732-879e-a92972ce4e0e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd Jul 07 22:40:54 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:54 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 Jul 07 22:40:54 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:55 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" returned: 0 in 0.826s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:55 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a Jul 07 22:40:55 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:55 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619d4544-2d51-4732-879e-a92972ce4e0e -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd" returned: 0 in 0.815s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:55 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd is being set with open permissions: ugo+rw Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:55 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd Jul 07 22:40:55 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:55 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:55 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:55 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a" returned: 0 in 0.828s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:55 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd" returned: 0 in 0.795s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:55 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a Jul 07 22:40:55 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:56 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.info Jul 07 22:40:56 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:56 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.744s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:40:56 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75.9f165e36-d509-467f-afc1-be5307e43f3a" returned: 0 in 0.711s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-9f165e36-d509-467f-afc1-be5307e43f3a" released by "_delete_snapshot" :: held 3.400s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" released by "delete_snapshot" :: held 3.429s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Created reservations ['2d2efa6f-0648-4fe8-add4-4c4c34e6ae82', '6b6f51ed-94f8-4fc5-882b-a90c4d57d81c', 'c7c1f123-5261-473b-8733-a63a32f369f7', '860bd2db-3cdb-47aa-838b-5827818ecf12'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:56 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.info" returned: 0 in 0.790s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:56 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.info is being set with open permissions: ugo+rw Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:56 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.info Jul 07 22:40:56 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Delete snapshot completed successfully. Jul 07 22:40:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a96cd956-b8d1-40c9-8078-e32dc8eda2db tempest-VolumeDependencyTests-361558233 None] Lock "cinder-9f165e36-d509-467f-afc1-be5307e43f3a-delete_snapshot" released by "delete_snapshot" :: held 3.615s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-quobyte-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:57 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.info" returned: 0 in 0.804s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.168s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e4f612-e529-46d6-b645-3f8018e46a10]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.487s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816270565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bf1087-0ab5-4eb5-b919-732ed6522086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:46Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Creating volume 65bf1087-0ab5-4eb5-b919-732ed6522086 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:57 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:57 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 1073741824 Jul 07 22:40:57 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:57 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5221c434-ddc7-4374-8c3a-87f0b173c851 tempest-VolumesSnapshotTestJSON-1005451233 None] Create snapshot completed successfully Jul 07 22:40:57 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 Jul 07 22:40:57 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:58 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" returned: 0 in 0.859s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:58 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75 Jul 07 22:40:58 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:58 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 1073741824" returned: 0 in 1.001s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:58 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 Jul 07 22:40:58 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:59 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" returned: 0 in 0.761s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75" released by "delete_volume" :: held 1.728s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Created reservations ['4092f05f-d38e-429a-a1ca-0182730ced7a', '79bf979e-1822-4fb0-8a9d-dabc8e7a6319', '805cd551-433c-419c-bc07-3b800cfd314f', '897456c9-e7d6-457e-aac1-748366b02a45'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (0a7a27f4-76c2-4d56-90d6-926bcaeee112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c8a994-56d9-4820-84ae-e946f3bbc932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:59 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c8a994-56d9-4820-84ae-e946f3bbc932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-939108071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963e10a8fd4344fbb70f131329c4b6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=43a95522-85e4-4b57-8337-6058e64584fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:59Z,use_quota=True,user_id='ba3362ffbba645e59d8b440bf1257299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6732f90-34b4-49a5-be82-7e2e3f45c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6732f90-34b4-49a5-be82-7e2e3f45c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9350bf-8acf-4880-986d-09fe38a5b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9350bf-8acf-4880-986d-09fe38a5b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0', 'volume_name': 'volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0', 'volume_size': 2, 'snapshot_id': '43a95522-85e4-4b57-8337-6058e64584fd'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8920432-5744-43d8-8790-9ca88e5f687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8920432-5744-43d8-8790-9ca88e5f687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897ffde0-6bae-4d41-b551-7a2fc15b54b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:59 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume 682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0', 'volume_size': 2, 'snapshot_id': '43a95522-85e4-4b57-8337-6058e64584fd'} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086" returned: 0 in 0.931s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.444s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:59 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-469742549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71954e5-442d-4fee-b15c-c4d5b01d462b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f9c52557ca4d9fb7104ed08ce0a04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:52Z,use_quota=True,user_id='b8d0f664b04d456e9458da8e4a28146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Creating volume b71954e5-442d-4fee-b15c-c4d5b01d462b {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:40:59 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:40:59 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acff2514-b3b6-40e5-a46d-1a9f0912bf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65bf1087-0ab5-4eb5-b919-732ed6522086', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a7dd15-dce9-46fd-8a4a-22648b3702f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:40:59 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b 1073741824 Jul 07 22:40:59 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:40:59 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume volume-65bf1087-0ab5-4eb5-b919-732ed6522086 (65bf1087-0ab5-4eb5-b919-732ed6522086): created successfully Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a7dd15-dce9-46fd-8a4a-22648b3702f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (a2e4dc4a-3aa9-436c-86db-d990aebc5c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:40:59 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5fe8fbaf-ec16-445f-b397-cffeb33e55b7 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created volume successfully. Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "cinder-quobyte-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbddc2a-fd36-46c3-8eee-97b0039968c5]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:40:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:00 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 Jul 07 22:41:00 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:00 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.936s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Deleted volume successfully. Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-be53f090-9a32-4d58-9e49-eb991c786d64 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-3d28c0c9-6cd7-4be9-bfe3-e8855487dd75-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:00 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b 1073741824" returned: 0 in 1.227s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (d8490efc-04b7-4c4e-88a1-996763615b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:00 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b Jul 07 22:41:00 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:00 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5842c62f-0678-4ff3-9807-61420f278b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" returned: 0 in 1.088s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:01 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803 Jul 07 22:41:01 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5842c62f-0678-4ff3-9807-61420f278b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141355293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0b3232-289c-4903-b2bb-5625f769cc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:01Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae53518-2ee6-4dfc-97de-1f3d262b4535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae53518-2ee6-4dfc-97de-1f3d262b4535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176f2f47-524a-4b7e-8705-fc8ccea63dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176f2f47-524a-4b7e-8705-fc8ccea63dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0b3232-289c-4903-b2bb-5625f769cc23', 'volume_name': 'volume-2c0b3232-289c-4903-b2bb-5625f769cc23', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec54908-ef85-438b-ad6f-180264f6080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec54908-ef85-438b-ad6f-180264f6080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42babdf-d651-4be1-8b85-b1e1470420dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume 2c0b3232-289c-4903-b2bb-5625f769cc23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0b3232-289c-4903-b2bb-5625f769cc23', 'volume_size': 1} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (0fe250b2-6fc0-4ff5-b81c-589ea442a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbf2cff-e9c9-4c77-a845-5bed13298e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbf2cff-e9c9-4c77-a845-5bed13298e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283188476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff13c488-fb63-43c9-b65a-c87b1d3fd681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:01Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c11ec3-2442-4202-a36c-2ca168f53089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c11ec3-2442-4202-a36c-2ca168f53089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1b2bb8-68b9-459d-a232-daaae00b2f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1b2bb8-68b9-459d-a232-daaae00b2f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff13c488-fb63-43c9-b65a-c87b1d3fd681', 'volume_name': 'volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f99367-487d-4836-a386-c803d16d795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f99367-487d-4836-a386-c803d16d795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d5d89b-0e4c-450f-a1be-972a193573d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume ff13c488-fb63-43c9-b65a-c87b1d3fd681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681', 'volume_size': 1} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:01 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b" returned: 0 in 0.991s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.312s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.294s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-43a95522-85e4-4b57-8337-6058e64584fd-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fdb67b-2c03-49ec-9fc1-745451f81542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71954e5-442d-4fee-b15c-c4d5b01d462b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdba1f40-11ed-4974-a374-07d210bd4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-43a95522-85e4-4b57-8337-6058e64584fd-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" acquired by "_create_volume_from_snapshot" :: waited 0.073s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Creating volume 682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 from snapshot 43a95522-85e4-4b57-8337-6058e64584fd {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:02 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Volume volume-b71954e5-442d-4fee-b15c-c4d5b01d462b (b71954e5-442d-4fee-b15c-c4d5b01d462b): created successfully Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdba1f40-11ed-4974-a374-07d210bd4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Flow 'volume_create_manager' (f0eb6562-65a7-4045-b156-e01a35ef6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" acquired by "_copy_volume_from_snapshot" :: waited 0.079s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] snapshot: 43a95522-85e4-4b57-8337-6058e64584fd, volume: 682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (4a76d04b-2859-46e1-a909-30609255b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96149760-87d3-4ce6-af9e-b5e800f42c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:02 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-09d5258c-28ca-4be8-af15-63287b4f9df2 tempest-ProjectReaderTests-2030105988 None] Created volume successfully. Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" returned: 0 in 1.216s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96149760-87d3-4ce6-af9e-b5e800f42c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106655399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8af0a18-2e84-437f-bab1-5ceaed5a102d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:02Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a460938-3535-4055-9a46-883216fe40bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a460938-3535-4055-9a46-883216fe40bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f297d7-57f2-4174-a3d5-c12f8e889a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f297d7-57f2-4174-a3d5-c12f8e889a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8af0a18-2e84-437f-bab1-5ceaed5a102d', 'volume_name': 'volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075c5ad3-104f-47eb-9804-91d57faaf7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075c5ad3-104f-47eb-9804-91d57faaf7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c48c06e-9062-4e3d-a767-ef1fdfa8a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume f8af0a18-2e84-437f-bab1-5ceaed5a102d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d', 'volume_size': 1} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c696e5d-a7f2-414d-b709-575c9652bc22]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-quobyte-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803" released by "delete_volume" :: held 2.432s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Created reservations ['5e33d93c-2849-4e9e-be8e-97bfef551cb2', 'c6276417-a6fc-4eb0-abb3-f86b7cf31690', 'c50729f4-6829-47d4-b0da-b96bd5b73d86', 'c4ca3f34-64c7-499c-bd1e-0ce26b78d065'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:02 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd Jul 07 22:41:02 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:02 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:02 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (0619b3ba-1a7f-431d-ac4b-ef3ddb360009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd4ca68-1415-42a7-b722-14c576068b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd4ca68-1415-42a7-b722-14c576068b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626781933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b577a3-0319-4f9e-aee6-f1aa103c415d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:02Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5de63eb-737e-45fc-af6d-7c62d496348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5de63eb-737e-45fc-af6d-7c62d496348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60f7be0-4044-4a0e-a451-71a2a96da6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60f7be0-4044-4a0e-a451-71a2a96da6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b577a3-0319-4f9e-aee6-f1aa103c415d', 'volume_name': 'volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20410752-b284-4c32-b22b-13a965c6d420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20410752-b284-4c32-b22b-13a965c6d420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7aff9d-d34b-4ffb-b423-94b08e1c2a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:02 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume a6b577a3-0319-4f9e-aee6-f1aa103c415d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d', 'volume_size': 1} Jul 07 22:41:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (54f1662f-b63d-473f-8273-e3cb72bb85a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12632f3-9422-4953-8917-9aa0f6be8226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12632f3-9422-4953-8917-9aa0f6be8226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039458918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:03Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae41087e-a91f-43f3-bce2-9c7307becb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae41087e-a91f-43f3-bce2-9c7307becb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f118ce-40a4-46d6-94fe-c485990ab2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f118ce-40a4-46d6-94fe-c485990ab2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516', 'volume_name': 'volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd420302-50aa-47b2-b63a-ba9a811f751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd420302-50aa-47b2-b63a-ba9a811f751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b51a8ad-4290-4965-94dc-58afb7bbdd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:03 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516', 'volume_size': 1} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "cinder-b71954e5-442d-4fee-b15c-c4d5b01d462b-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-b71954e5-442d-4fee-b15c-c4d5b01d462b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "cinder-quobyte-b71954e5-442d-4fee-b15c-c4d5b01d462b" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-quobyte-b71954e5-442d-4fee-b15c-c4d5b01d462b" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abf93a8-698a-4f44-9195-2622708defc8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:03 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.938s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:03 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Deleted volume successfully. Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c2d5aa2a-b595-46da-a6c6-8e68a3d34e54 tempest-VolumeDependencyTests-361558233 None] Lock "cinder-2d754ed4-c72b-4e1e-8bc7-ff4782c5c803-delete_volume" released by "delete_volume" :: held 3.673s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:03 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b Jul 07 22:41:03 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:03 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd" returned: 0 in 1.258s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-619d4544-2d51-4732-879e-a92972ce4e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac665f5c-5b69-4114-9d12-e63cd20abf0b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:03 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e Jul 07 22:41:03 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:04 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b" returned: 0 in 1.080s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:04 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b Jul 07 22:41:04 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:04 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e" returned: 0 in 1.129s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:04 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:41:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:04 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 Jul 07 22:41:04 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:05 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b71954e5-442d-4fee-b15c-c4d5b01d462b" returned: 0 in 0.904s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-quobyte-b71954e5-442d-4fee-b15c-c4d5b01d462b" released by "delete_volume" :: held 2.057s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Created reservations ['294ea736-942a-4c05-a6f6-4f6daf8871bc', '2e277bd0-2347-4742-9aee-437dc742731e', '1fec6ed9-ea12-459c-988b-1c90269d7d28', 'ca0ee116-39e1-4f0e-9160-25f6382facce'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:05 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:05 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:07 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 2.152s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:07 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Deleted volume successfully. Jul 07 22:41:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a33d4522-a7fa-4529-9bc6-d88563a5fad2 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-b71954e5-442d-4fee-b15c-c4d5b01d462b-delete_volume" released by "delete_volume" :: held 4.656s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Flow 'volume_create_manager' (1fd088a2-5605-4eb0-a770-1380d5008823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0178a0c3-2d21-4280-89cd-b8f106023436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0178a0c3-2d21-4280-89cd-b8f106023436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566968875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e83d8a-1507-4841-93c1-a0254c13edf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f9c52557ca4d9fb7104ed08ce0a04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:08Z,use_quota=True,user_id='b8d0f664b04d456e9458da8e4a28146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c049dea-30b0-4679-9e9c-0fb17563d2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c049dea-30b0-4679-9e9c-0fb17563d2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c25a957-94c4-4416-bb29-3145ad6a4cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c25a957-94c4-4416-bb29-3145ad6a4cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e83d8a-1507-4841-93c1-a0254c13edf2', 'volume_name': 'volume-41e83d8a-1507-4841-93c1-a0254c13edf2', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae050a0-bc41-4dff-9858-adcf41f4d65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae050a0-bc41-4dff-9858-adcf41f4d65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3e636e-b6ae-4124-88d9-3748f9a758cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:09 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Volume 41e83d8a-1507-4841-93c1-a0254c13edf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e83d8a-1507-4841-93c1-a0254c13edf2', 'volume_size': 1} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Flow 'volume_create_manager' (86d97789-e3ef-4b8e-9f74-5d5fae40114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270f1e95-0547-4f5a-aea9-e6b7f67342d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270f1e95-0547-4f5a-aea9-e6b7f67342d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67495e2-de28-488b-acda-531d66e75f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff3c6f640e04bc6b1a0c58ea46ca107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:09Z,use_quota=True,user_id='81cbf9d65bbc4b7db7751e9a4c83b029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9afa60-ccac-450d-81f1-df860248ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9afa60-ccac-450d-81f1-df860248ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21136fce-99fb-4af0-8242-4f197656b155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21136fce-99fb-4af0-8242-4f197656b155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67495e2-de28-488b-acda-531d66e75f7b', 'volume_name': 'volume-c67495e2-de28-488b-acda-531d66e75f7b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03129739-39f6-406a-b56f-bb2e75d7ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03129739-39f6-406a-b56f-bb2e75d7ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6137611-c4b2-4632-9b2f-24394c1133d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:09 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Volume c67495e2-de28-488b-acda-531d66e75f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67495e2-de28-488b-acda-531d66e75f7b', 'volume_size': 1} Jul 07 22:41:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:11 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" returned: 0 in 6.571s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:11 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17096d8-102f-4761-889b-8e19186dde6d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:11 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e Jul 07 22:41:11 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:12 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e" returned: 0 in 1.109s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:12 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:41:12 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Converted 1024.00 MB image at 155.82 MB/s Jul 07 22:41:12 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 is being set with open permissions: ugo+rw Jul 07 22:41:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:12 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 Jul 07 22:41:12 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:13 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" returned: 0 in 0.775s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" released by "_copy_volume_from_snapshot" :: held 11.086s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-43a95522-85e4-4b57-8337-6058e64584fd-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" released by "_create_volume_from_snapshot" :: held 11.191s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.267s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.127s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141355293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0b3232-289c-4903-b2bb-5625f769cc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:01Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Creating volume 2c0b3232-289c-4903-b2bb-5625f769cc23 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:13 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:13 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 1073741824 Jul 07 22:41:13 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897ffde0-6bae-4d41-b551-7a2fc15b54b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0', 'volume_size': 2, 'snapshot_id': '43a95522-85e4-4b57-8337-6058e64584fd'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95f9714-8b06-4cce-a4f6-e1fdba394e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:13 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 (682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0): created successfully Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95f9714-8b06-4cce-a4f6-e1fdba394e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (0a7a27f4-76c2-4d56-90d6-926bcaeee112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-758ad8fe-7168-4580-8ed6-91cce3d60e67 tempest-VolumesSnapshotTestJSON-1005451233 None] Created volume successfully. Jul 07 22:41:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:14 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1f683b-fccb-43c2-8b7e-de1951b6e32b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:14 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 1073741824" returned: 0 in 1.087s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:14 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 Jul 07 22:41:14 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:14 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 Jul 07 22:41:14 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:15 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23" returned: 0 in 0.797s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:15 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.628s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283188476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff13c488-fb63-43c9-b65a-c87b1d3fd681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:01Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Creating volume ff13c488-fb63-43c9-b65a-c87b1d3fd681 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:15 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" returned: 0 in 0.966s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:15 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 1073741824 Jul 07 22:41:15 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:15 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0 Jul 07 22:41:15 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42babdf-d651-4be1-8b85-b1e1470420dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0b3232-289c-4903-b2bb-5625f769cc23', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605ace79-1a18-4511-8fa6-44484a2589af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume volume-2c0b3232-289c-4903-b2bb-5625f769cc23 (2c0b3232-289c-4903-b2bb-5625f769cc23): created successfully Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605ace79-1a18-4511-8fa6-44484a2589af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (d8490efc-04b7-4c4e-88a1-996763615b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a673de6f-b41e-49e6-a6f1-41c7faaa1e0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created volume successfully. Jul 07 22:41:16 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" returned: 0 in 0.819s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0" released by "delete_volume" :: held 1.864s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Created reservations ['68a15714-a17d-47b7-848c-dccda44ce822', 'aefec17e-8078-470c-9f94-a4e02012d029', '2a727a5d-2b18-4e0a-a9ec-794fb764dd11', 'f29e87d5-0641-4eff-88ae-bcff19846f7d'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:16 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:16 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:16 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 1073741824" returned: 0 in 1.077s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:16 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 Jul 07 22:41:16 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-43a95522-85e4-4b57-8337-6058e64584fd-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-43a95522-85e4-4b57-8337-6058e64584fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-619d4544-2d51-4732-879e-a92972ce4e0e" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-619d4544-2d51-4732-879e-a92972ce4e0e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-43a95522-85e4-4b57-8337-6058e64584fd" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-43a95522-85e4-4b57-8337-6058e64584fd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Deleting offline snapshot 43a95522-85e4-4b57-8337-6058e64584fd of volume 619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] snapshot_file for this snap is: volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ed50d7-eb4c-4e59-9c13-4fa8d3d62adb]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:16 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd Jul 07 22:41:16 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:17 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.827s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Deleted volume successfully. Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-39f05c38-013c-4029-a62c-b1f93362bce5 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-682cc7dc-46f5-4e9f-a7cd-f0e1597d54a0-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:17 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681" returned: 0 in 0.841s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.893s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106655399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8af0a18-2e84-437f-bab1-5ceaed5a102d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:02Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Creating volume f8af0a18-2e84-437f-bab1-5ceaed5a102d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:17 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d5d89b-0e4c-450f-a1be-972a193573d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:17 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d 1073741824 Jul 07 22:41:17 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a9820e-84ff-4e01-9644-c31886e99192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:17 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 (ff13c488-fb63-43c9-b65a-c87b1d3fd681): created successfully Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a9820e-84ff-4e01-9644-c31886e99192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (0fe250b2-6fc0-4ff5-b81c-589ea442a377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-10c188f9-46c8-4cfe-8ddc-0c43f5b5ec44 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created volume successfully. Jul 07 22:41:17 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd" returned: 0 in 0.920s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-619d4544-2d51-4732-879e-a92972ce4e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a76c9e7-e643-4940-890d-fe4f81ffd2a2]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:17 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e Jul 07 22:41:17 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:18 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d 1073741824" returned: 0 in 0.989s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:18 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d Jul 07 22:41:18 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:18 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e" returned: 0 in 0.944s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:18 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd Jul 07 22:41:18 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:18 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d" returned: 0 in 0.776s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.351s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626781933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b577a3-0319-4f9e-aee6-f1aa103c415d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:02Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Creating volume a6b577a3-0319-4f9e-aee6-f1aa103c415d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:19 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:19 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d 1073741824 Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c48c06e-9062-4e3d-a767-ef1fdfa8a435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:19 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6a1bc7-34d3-4ee2-a40c-a9f5a46b6b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:19 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d (f8af0a18-2e84-437f-bab1-5ceaed5a102d): created successfully Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6a1bc7-34d3-4ee2-a40c-a9f5a46b6b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (4a76d04b-2859-46e1-a909-30609255b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9537b19b-c5b6-4883-ab0e-ea39b26d6f49 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created volume successfully. Jul 07 22:41:19 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd" returned: 0 in 0.923s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:19 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd Jul 07 22:41:19 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:20 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d 1073741824" returned: 0 in 1.098s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:20 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d Jul 07 22:41:20 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:20 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e.43a95522-85e4-4b57-8337-6058e64584fd" returned: 0 in 0.786s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-43a95522-85e4-4b57-8337-6058e64584fd" released by "_delete_snapshot" :: held 3.726s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-619d4544-2d51-4732-879e-a92972ce4e0e" released by "delete_snapshot" :: held 3.761s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Created reservations ['441c4b89-18cd-474b-9078-b7d0578cf24d', '467dd3eb-95e9-4963-8ab7-952e1597433c', 'c101f6e0-dff3-434d-9b75-8547983955ae', '657a0d56-37b1-422a-ae77-a9ff0df23e74'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:20 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Delete snapshot completed successfully. Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3c4dc672-a7f3-4ab9-9b11-87e1505779e2 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-43a95522-85e4-4b57-8337-6058e64584fd-delete_snapshot" released by "delete_snapshot" :: held 3.999s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-619d4544-2d51-4732-879e-a92972ce4e0e-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-619d4544-2d51-4732-879e-a92972ce4e0e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:20 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d" returned: 0 in 0.821s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.834s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039458918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67266c9aa46547b7b7499a69e6aed328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:03Z,use_quota=True,user_id='d7aa9f3dce4c41c5afe30548ab4371e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Creating volume f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:21 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:21 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 1073741824 Jul 07 22:41:21 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7aff9d-d34b-4ffb-b423-94b08e1c2a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0120c5e4-5aa7-4f9d-92c5-27690a992d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-619d4544-2d51-4732-879e-a92972ce4e0e" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:21 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d (a6b577a3-0319-4f9e-aee6-f1aa103c415d): created successfully Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0120c5e4-5aa7-4f9d-92c5-27690a992d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (0619b3ba-1a7f-431d-ac4b-ef3ddb360009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-619d4544-2d51-4732-879e-a92972ce4e0e" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:21 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-349db002-cdd2-42ae-aada-0aa6163fa278 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created volume successfully. Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10ab057-f399-4a20-b098-2b1310cb72cf]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:21 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e Jul 07 22:41:21 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:21 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 1073741824" returned: 0 in 0.948s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:22 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 Jul 07 22:41:22 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:22 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e" returned: 0 in 0.920s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:22 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e Jul 07 22:41:22 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:22 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516" returned: 0 in 0.673s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.844s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566968875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e83d8a-1507-4841-93c1-a0254c13edf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f9c52557ca4d9fb7104ed08ce0a04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:08Z,use_quota=True,user_id='b8d0f664b04d456e9458da8e4a28146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Creating volume 41e83d8a-1507-4841-93c1-a0254c13edf2 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:22 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:22 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 1073741824 Jul 07 22:41:22 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:23 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-619d4544-2d51-4732-879e-a92972ce4e0e" returned: 0 in 0.850s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-619d4544-2d51-4732-879e-a92972ce4e0e" released by "delete_volume" :: held 1.869s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b51a8ad-4290-4965-94dc-58afb7bbdd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a683d6-6e08-4686-a810-b901eb44dcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:23 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Created reservations ['5759ad4c-7452-4691-9291-356f13aa03dd', '73377498-7002-4335-9a68-7fd616c1407b', '238a830d-ea07-4009-b222-cacfc883688e', '70d8d0ab-bef1-4467-b708-f02c78269203'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:23 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Volume volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 (f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516): created successfully Jul 07 22:41:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a683d6-6e08-4686-a810-b901eb44dcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Flow 'volume_create_manager' (54f1662f-b63d-473f-8273-e3cb72bb85a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:23 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 1073741824" returned: 0 in 0.942s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9740012a-85b3-453e-abf1-2ccb73228a70 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created volume successfully. Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:25 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 Jul 07 22:41:25 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:25 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:25 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:25 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2" returned: 0 in 0.746s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] <== create_volume: return (3032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.035s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.286s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67495e2-de28-488b-acda-531d66e75f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff3c6f640e04bc6b1a0c58ea46ca107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:09Z,use_quota=True,user_id='81cbf9d65bbc4b7db7751e9a4c83b029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Creating volume c67495e2-de28-488b-acda-531d66e75f7b {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:25 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:25 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b 1073741824 Jul 07 22:41:25 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:26 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.717s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:26 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Deleted volume successfully. Jul 07 22:41:26 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b 1073741824" returned: 0 in 0.833s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3e636e-b6ae-4124-88d9-3748f9a758cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e83d8a-1507-4841-93c1-a0254c13edf2', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4827db58-c886-4032-9441-7210666f5b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e5393fa8-1d6e-432d-abee-2a4bf0929b63 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-619d4544-2d51-4732-879e-a92972ce4e0e-delete_volume" released by "delete_volume" :: held 6.719s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:27 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Volume volume-41e83d8a-1507-4841-93c1-a0254c13edf2 (41e83d8a-1507-4841-93c1-a0254c13edf2): created successfully Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4827db58-c886-4032-9441-7210666f5b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Flow 'volume_create_manager' (1fd088a2-5605-4eb0-a770-1380d5008823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-quobyte-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:27 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b Jul 07 22:41:27 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:27 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e835a254-1bf5-42c7-8ff8-0c9476e6c469 tempest-ProjectReaderTests-2030105988 None] Created volume successfully. Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9e2dee-41da-4ecd-b339-1d08e19cdb38]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:27 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 Jul 07 22:41:27 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (2067802f-8f03-429b-b812-2afa97b49556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536a9927-e097-4ae6-b86e-75b3d2b12850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536a9927-e097-4ae6-b86e-75b3d2b12850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-770430480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657ae111-0f14-41e1-8641-090046354b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963e10a8fd4344fbb70f131329c4b6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:28Z,use_quota=True,user_id='ba3362ffbba645e59d8b440bf1257299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c09edb-9e76-4a91-909b-29202db1fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c09edb-9e76-4a91-909b-29202db1fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6072435a-e096-47c9-a63f-515f48e7d3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6072435a-e096-47c9-a63f-515f48e7d3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657ae111-0f14-41e1-8641-090046354b28', 'volume_name': 'volume-657ae111-0f14-41e1-8641-090046354b28', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1972c0-95aa-4eca-83e6-7e9c48756263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1972c0-95aa-4eca-83e6-7e9c48756263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f8dd3b-73ba-41f4-93e4-8d1f9f09f273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume 657ae111-0f14-41e1-8641-090046354b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657ae111-0f14-41e1-8641-090046354b28', 'volume_size': 1} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:28 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b" returned: 0 in 0.772s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] <== create_volume: return (2564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.569s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.290s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-770430480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657ae111-0f14-41e1-8641-090046354b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963e10a8fd4344fbb70f131329c4b6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:28Z,use_quota=True,user_id='ba3362ffbba645e59d8b440bf1257299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Creating volume 657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:28 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:28 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 1073741824 Jul 07 22:41:28 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6137611-c4b2-4632-9b2f-24394c1133d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67495e2-de28-488b-acda-531d66e75f7b', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde9e18a-e761-4b7d-8021-c2f3b7a86e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Volume volume-c67495e2-de28-488b-acda-531d66e75f7b (c67495e2-de28-488b-acda-531d66e75f7b): created successfully Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde9e18a-e761-4b7d-8021-c2f3b7a86e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Flow 'volume_create_manager' (86d97789-e3ef-4b8e-9f74-5d5fae40114b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-51cac584-7f2e-4b83-84a7-468f0b600709 tempest-CinderUnicodeTest-249690754 None] Created volume successfully. Jul 07 22:41:28 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516" returned: 0 in 0.957s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:28 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516 Jul 07 22:41:28 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "cinder-41e83d8a-1507-4841-93c1-a0254c13edf2-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-41e83d8a-1507-4841-93c1-a0254c13edf2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "cinder-quobyte-41e83d8a-1507-4841-93c1-a0254c13edf2" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-quobyte-41e83d8a-1507-4841-93c1-a0254c13edf2" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7c54d-e797-4b60-b1c4-9964de30b4e7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:29 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 Jul 07 22:41:29 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:29 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 1073741824" returned: 0 in 1.022s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:29 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516" returned: 0 in 0.794s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516" released by "delete_volume" :: held 1.828s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:29 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 Jul 07 22:41:29 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created reservations ['447c7e81-6561-4a2c-8318-0f0f3963f14c', '75d86f7f-abc7-45f1-91d4-fa7327a5f6d6', '245e5b6a-de86-41d3-b76b-5b6428b44d3e', '41d2ecad-b15d-4009-8c08-85bbf346d4ba'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:29 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:29 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-a6b577a3-0319-4f9e-aee6-f1aa103c415d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-a6b577a3-0319-4f9e-aee6-f1aa103c415d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-quobyte-a6b577a3-0319-4f9e-aee6-f1aa103c415d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-a6b577a3-0319-4f9e-aee6-f1aa103c415d" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb2bca-4b94-4e5a-b745-d95668e7b239]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:30 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2" returned: 0 in 1.247s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:30 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2 Jul 07 22:41:30 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d Jul 07 22:41:30 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:30 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:30 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28" returned: 0 in 1.082s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f8dd3b-73ba-41f4-93e4-8d1f9f09f273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657ae111-0f14-41e1-8641-090046354b28', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f392d7-b037-42ca-a1c3-c662cc7dbdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Volume volume-657ae111-0f14-41e1-8641-090046354b28 (657ae111-0f14-41e1-8641-090046354b28): created successfully Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f392d7-b037-42ca-a1c3-c662cc7dbdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (2067802f-8f03-429b-b812-2afa97b49556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-14b46415-97ce-4f72-bb36-a46b8c5e9da7 tempest-VolumesSnapshotTestJSON-1005451233 None] Created volume successfully. Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Flow 'volume_create_manager' (e581c6bc-f0e4-4525-99de-8b46656d3fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e71839-ed79-4aaf-8f34-5b31f41098fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e71839-ed79-4aaf-8f34-5b31f41098fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1625665222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04effa7-e118-42d6-9d44-c1a7a8c63c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff3c6f640e04bc6b1a0c58ea46ca107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:31Z,use_quota=True,user_id='81cbf9d65bbc4b7db7751e9a4c83b029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5102a1-8a25-4a23-bc83-87b753eaf310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5102a1-8a25-4a23-bc83-87b753eaf310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45218e93-31c7-4cad-b017-9cca6f785c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45218e93-31c7-4cad-b017-9cca6f785c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04effa7-e118-42d6-9d44-c1a7a8c63c90', 'volume_name': 'volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2e0724-53d7-4cd6-90a6-8107ce0f5a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2e0724-53d7-4cd6-90a6-8107ce0f5a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c09fd7f-c089-4b2a-99ad-759b16e9640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Volume d04effa7-e118-42d6-9d44-c1a7a8c63c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90', 'volume_size': 1} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1625665222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04effa7-e118-42d6-9d44-c1a7a8c63c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff3c6f640e04bc6b1a0c58ea46ca107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:31Z,use_quota=True,user_id='81cbf9d65bbc4b7db7751e9a4c83b029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Creating volume d04effa7-e118-42d6-9d44-c1a7a8c63c90 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:30 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:30 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.145s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:30 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:30 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 1073741824 Jul 07 22:41:30 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Deleted volume successfully. Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c8631cd0-b65b-4f81-b743-b751508f8c0b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-f27c7d22-b7e1-48a0-bcfa-b33ad9d6d516-delete_volume" released by "delete_volume" :: held 3.565s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:31 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-41e83d8a-1507-4841-93c1-a0254c13edf2" returned: 0 in 1.165s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-quobyte-41e83d8a-1507-4841-93c1-a0254c13edf2" released by "delete_volume" :: held 2.474s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:31 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d" returned: 0 in 1.329s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:31 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d Jul 07 22:41:31 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Created reservations ['403240b8-b73f-4552-a79a-05fcf6bc774b', '89f15afc-ec6a-4ce6-998c-8e32e72fd501', 'fb484ec2-2bc5-4838-8f06-17576e719657', 'dcd68b17-9785-4bd4-b2c2-9a876621a196'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:31 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:31 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:32 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 1073741824" returned: 0 in 1.216s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:32 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 Jul 07 22:41:32 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:32 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6b577a3-0319-4f9e-aee6-f1aa103c415d" returned: 0 in 0.941s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-a6b577a3-0319-4f9e-aee6-f1aa103c415d" released by "delete_volume" :: held 2.367s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created reservations ['cf658857-e78b-4eff-8b6c-741d51e593ad', '14f08b93-2f1e-49e0-8fc0-4b7850f68653', '9c205ca1-d8eb-4456-bbae-86c9492579b9', 'b23b7ccd-380c-45c6-aa0f-0cfa7552d570'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:32 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.909s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:32 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Deleted volume successfully. Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6d233db6-a98b-45b6-8f91-138fd3235ea0 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-41e83d8a-1507-4841-93c1-a0254c13edf2-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:32 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:32 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Flow 'volume_create_manager' (7f302c3b-0e90-466e-8c5d-8662ed9d34a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d365644a-922f-4184-86ca-3eaedca631cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d365644a-922f-4184-86ca-3eaedca631cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170427336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5623792a-3bfc-43e0-ba35-25e0a969de66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f9c52557ca4d9fb7104ed08ce0a04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:33Z,use_quota=True,user_id='b8d0f664b04d456e9458da8e4a28146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4963b57b-d2ac-47a7-a895-b09edb110340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4963b57b-d2ac-47a7-a895-b09edb110340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9d7fa7-6e16-41eb-b109-fb1eae2d263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9d7fa7-6e16-41eb-b109-fb1eae2d263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5623792a-3bfc-43e0-ba35-25e0a969de66', 'volume_name': 'volume-5623792a-3bfc-43e0-ba35-25e0a969de66', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bae1b7-11ee-4a0d-b596-7a586827f777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bae1b7-11ee-4a0d-b596-7a586827f777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c874ddcf-e077-4897-bf58-4268625a09f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:33 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Volume 5623792a-3bfc-43e0-ba35-25e0a969de66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5623792a-3bfc-43e0-ba35-25e0a969de66', 'volume_size': 1} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:33 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90" returned: 0 in 0.937s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.494s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Creating offline snapshot 743af3d2-5967-468e-872b-f88edcdf0802 of volume 657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c09fd7f-c089-4b2a-99ad-759b16e9640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2137246-ceb4-4080-b8be-a8466bd2fc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d6e3ab-f2e3-4947-b9e0-0523be5c75b5]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:33 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Volume volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 (d04effa7-e118-42d6-9d44-c1a7a8c63c90): created successfully Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2137246-ceb4-4080-b8be-a8466bd2fc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Flow 'volume_create_manager' (e581c6bc-f0e4-4525-99de-8b46656d3fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-0b2b1860-6596-4933-b334-b19990459e73 tempest-CinderUnicodeTest-249690754 None] Created volume successfully. Jul 07 22:41:33 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 Jul 07 22:41:33 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-f8af0a18-2e84-437f-bab1-5ceaed5a102d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-f8af0a18-2e84-437f-bab1-5ceaed5a102d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-quobyte-f8af0a18-2e84-437f-bab1-5ceaed5a102d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:33 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.835s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Deleted volume successfully. Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-f8af0a18-2e84-437f-bab1-5ceaed5a102d" acquired by "delete_volume" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4992624a-caac-4ffa-a0f1-fb3127009925 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-a6b577a3-0319-4f9e-aee6-f1aa103c415d-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4359ed9c-1e78-424b-926a-f7b353f70fe9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:33 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d Jul 07 22:41:33 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:34 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28" returned: 0 in 0.983s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:34 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 1G Jul 07 22:41:34 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:34 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d" returned: 0 in 0.997s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:34 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d Jul 07 22:41:34 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:35 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 1G" returned: 0 in 0.967s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657ae111-0f14-41e1-8641-090046354b28 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:35 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657ae111-0f14-41e1-8641-090046354b28 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 Jul 07 22:41:35 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:35 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f8af0a18-2e84-437f-bab1-5ceaed5a102d" returned: 0 in 0.791s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-f8af0a18-2e84-437f-bab1-5ceaed5a102d" released by "delete_volume" :: held 1.842s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created reservations ['1e66bbd0-0969-49ce-9b42-eed121676bf1', '502bca93-0c5c-4489-87fb-c2b32e5f4f4a', 'e3709cd9-d5ba-4057-93b8-8b05bc1be116', 'c3243627-37f6-414c-b0c2-9c9f69a52ecb'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:35 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:35 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-ff13c488-fb63-43c9-b65a-c87b1d3fd681-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-ff13c488-fb63-43c9-b65a-c87b1d3fd681-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-quobyte-ff13c488-fb63-43c9-b65a-c87b1d3fd681" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-ff13c488-fb63-43c9-b65a-c87b1d3fd681" acquired by "delete_volume" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3d7140-0c80-4709-a913-c69b04f5716d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:36 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 Jul 07 22:41:36 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:36 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657ae111-0f14-41e1-8641-090046354b28 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802" returned: 0 in 0.928s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:36 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 is being set with open permissions: ugo+rw Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:36 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 Jul 07 22:41:36 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:36 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.846s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:36 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Deleted volume successfully. Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4679a200-c2d5-46da-ab09-dde3709474f2 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-f8af0a18-2e84-437f-bab1-5ceaed5a102d-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:36 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681" returned: 0 in 0.937s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:36 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681 Jul 07 22:41:36 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:36 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802" returned: 0 in 0.844s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=108,cinder:INSERT=34,cinder:UPDATE=137,cinder:DELETE=16 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:41:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:37 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.info Jul 07 22:41:37 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:37 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ff13c488-fb63-43c9-b65a-c87b1d3fd681" returned: 0 in 0.798s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-ff13c488-fb63-43c9-b65a-c87b1d3fd681" released by "delete_volume" :: held 1.793s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created reservations ['76bcce67-6832-4035-b2be-8c0ac0ec76d8', '0e2d6995-b0bf-442b-9939-772396775ff9', '57934315-a658-43ea-bad6-5b878b8e7a3b', '3f9b1c49-d57c-43bf-9432-8d336c0e1702'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:37 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:37 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:37 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.info" returned: 0 in 0.873s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:37 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.info is being set with open permissions: ugo+rw Jul 07 22:41:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:37 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.info Jul 07 22:41:37 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-2c0b3232-289c-4903-b2bb-5625f769cc23-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-2c0b3232-289c-4903-b2bb-5625f769cc23-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-quobyte-2c0b3232-289c-4903-b2bb-5625f769cc23" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-2c0b3232-289c-4903-b2bb-5625f769cc23" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d5e0e9-e9bd-4181-bfe0-5b67e9981f47]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:38 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 Jul 07 22:41:38 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:38 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.833s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:38 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Deleted volume successfully. Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8d9d5506-30fa-4727-81e4-b4132227a946 tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-ff13c488-fb63-43c9-b65a-c87b1d3fd681-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:38 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.info" returned: 0 in 0.842s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.549s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.696s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170427336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5623792a-3bfc-43e0-ba35-25e0a969de66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f9c52557ca4d9fb7104ed08ce0a04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:33Z,use_quota=True,user_id='b8d0f664b04d456e9458da8e4a28146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Creating volume 5623792a-3bfc-43e0-ba35-25e0a969de66 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:38 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:38 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 1073741824 Jul 07 22:41:38 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:38 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-dc3274f0-79f9-4403-99f7-ef79554fcfb9 tempest-VolumesSnapshotTestJSON-1005451233 None] Create snapshot completed successfully Jul 07 22:41:39 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23" returned: 0 in 0.931s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:39 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23 Jul 07 22:41:39 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (4b0f1a7e-72ce-4543-8d3d-31f1e1b1638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b77706d-e61c-4c21-96f1-682b541d5240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b77706d-e61c-4c21-96f1-682b541d5240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-945315498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d4f1a9-5da4-4475-9f2d-03716290576a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963e10a8fd4344fbb70f131329c4b6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=743af3d2-5967-468e-872b-f88edcdf0802,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:40Z,use_quota=True,user_id='ba3362ffbba645e59d8b440bf1257299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f4374f-0319-46bf-94d0-95f31430448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:39 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f4374f-0319-46bf-94d0-95f31430448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b54cd6-2a8f-4975-8cfc-5738a0c044e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b54cd6-2a8f-4975-8cfc-5738a0c044e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1d4f1a9-5da4-4475-9f2d-03716290576a', 'volume_name': 'volume-f1d4f1a9-5da4-4475-9f2d-03716290576a', 'volume_size': 1, 'snapshot_id': '743af3d2-5967-468e-872b-f88edcdf0802'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860a62ad-aa69-49e1-ab91-736e8a9dbcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860a62ad-aa69-49e1-ab91-736e8a9dbcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0cfbb2-ee0c-4be5-9b72-b789608f0f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:39 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Volume f1d4f1a9-5da4-4475-9f2d-03716290576a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1d4f1a9-5da4-4475-9f2d-03716290576a', 'volume_size': 1, 'snapshot_id': '743af3d2-5967-468e-872b-f88edcdf0802'} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 1073741824" returned: 0 in 1.209s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:39 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2c0b3232-289c-4903-b2bb-5625f769cc23" returned: 0 in 0.888s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:40 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 Jul 07 22:41:40 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-2c0b3232-289c-4903-b2bb-5625f769cc23" released by "delete_volume" :: held 1.874s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created reservations ['7b6ebe02-3c50-420a-8aee-b07d9060ed9e', '64eecb8b-23b3-465d-9f82-8d737cdd608b', '500d295c-37f6-40e5-a0b4-251846346e25', 'a8d43595-3a17-43ef-8dcb-a3a5009fbe94'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:40 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:40 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-65bf1087-0ab5-4eb5-b919-732ed6522086-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-65bf1087-0ab5-4eb5-b919-732ed6522086-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "cinder-quobyte-65bf1087-0ab5-4eb5-b919-732ed6522086" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-65bf1087-0ab5-4eb5-b919-732ed6522086" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa97bd05-c6ad-4c5b-b4b1-08880c05a6f1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:40 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 Jul 07 22:41:40 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:40 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66" returned: 0 in 0.858s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.458s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c874ddcf-e077-4897-bf58-4268625a09f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5623792a-3bfc-43e0-ba35-25e0a969de66', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4478c7d8-1f99-43c6-8271-fdd9f3f49fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Creating offline snapshot e2a597e7-b3d3-42ab-9761-f589e5bbe05f of volume d04effa7-e118-42d6-9d44-c1a7a8c63c90 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:41:40 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Volume volume-5623792a-3bfc-43e0-ba35-25e0a969de66 (5623792a-3bfc-43e0-ba35-25e0a969de66): created successfully Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4478c7d8-1f99-43c6-8271-fdd9f3f49fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Flow 'volume_create_manager' (7f302c3b-0e90-466e-8c5d-8662ed9d34a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3863683-3cbc-4f6e-976e-f3b14eafce79]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-48f3a299-0551-426d-b088-337557ff3192 tempest-ProjectReaderTests-2030105988 None] Created volume successfully. Jul 07 22:41:41 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 Jul 07 22:41:41 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:41 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.913s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Deleted volume successfully. Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7a3bf29-0309-4ec9-9a37-270a8f0a0c6b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-2c0b3232-289c-4903-b2bb-5625f769cc23-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:41 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086" returned: 0 in 0.978s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:41 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086 Jul 07 22:41:41 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Acquiring lock "cinder-5623792a-3bfc-43e0-ba35-25e0a969de66-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Lock "cinder-5623792a-3bfc-43e0-ba35-25e0a969de66-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:41 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90" returned: 0 in 0.953s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:41 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f 1G Jul 07 22:41:41 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Acquiring lock "cinder-quobyte-5623792a-3bfc-43e0-ba35-25e0a969de66" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Lock "cinder-quobyte-5623792a-3bfc-43e0-ba35-25e0a969de66" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb94008-e7bc-4df4-a021-909ed4a6870d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:42 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 Jul 07 22:41:42 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:42 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-65bf1087-0ab5-4eb5-b919-732ed6522086" returned: 0 in 0.833s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-quobyte-65bf1087-0ab5-4eb5-b919-732ed6522086" released by "delete_volume" :: held 1.889s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Created reservations ['803a5406-22ec-40cf-813d-6a5800f3c210', '639b60d0-670c-4530-a461-9fa7616528df', '74e50d7e-5be3-4a12-9286-aa9a473e0c37', '4cd9fdd0-81f3-4582-8c75-0c00a17f8a47'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:42 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:42 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:43 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66" returned: 0 in 1.073s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:43 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f 1G" returned: 0 in 1.191s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:43 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66 Jul 07 22:41:43 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:43 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f Jul 07 22:41:43 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:43 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.977s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:43 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Deleted volume successfully. Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-08ef6273-f853-4642-bf60-76d8800aa52b tempest-CreateVolumesFromSourceVolumeTest-1774015010 None] Lock "cinder-65bf1087-0ab5-4eb5-b919-732ed6522086-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:43 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5623792a-3bfc-43e0-ba35-25e0a969de66" returned: 0 in 0.838s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Lock "cinder-quobyte-5623792a-3bfc-43e0-ba35-25e0a969de66" released by "delete_volume" :: held 1.968s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Created reservations ['d036001f-7fa2-4630-aa42-3f34dd519c08', '937cfbea-d037-4c9b-8057-84a0af2be6d3', 'a1e7783b-9059-43a4-952c-3d386c670665', 'b6dcf831-6aa7-4dc4-b1de-090e50da1ea3'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:44 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f" returned: 0 in 1.079s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:44 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f is being set with open permissions: ugo+rw Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:44 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:44 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:44 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f Jul 07 22:41:44 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Flow 'volume_create_manager' (c11cdf96-24ef-45d8-9106-303bc15a84e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5628efdb-6ea9-4f4c-867d-8e339fa8c8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5628efdb-6ea9-4f4c-867d-8e339fa8c8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891567206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ccbcdd-2d6f-435f-9187-ae295b7963e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f9c52557ca4d9fb7104ed08ce0a04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:45Z,use_quota=True,user_id='b8d0f664b04d456e9458da8e4a28146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c079adf-dd1f-4e06-8d1f-d254e9034064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c079adf-dd1f-4e06-8d1f-d254e9034064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca012fc-d0bd-475e-888d-890576b865bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca012fc-d0bd-475e-888d-890576b865bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ccbcdd-2d6f-435f-9187-ae295b7963e8', 'volume_name': 'volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5225aefb-02d2-4c31-8535-7328751cca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5225aefb-02d2-4c31-8535-7328751cca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3def5f-ec1a-4369-8b32-bfdcc32ae192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:44 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Volume e8ccbcdd-2d6f-435f-9187-ae295b7963e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8', 'volume_size': 1} Jul 07 22:41:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:45 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f" returned: 0 in 0.959s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:45 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.008s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:45 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Deleted volume successfully. Jul 07 22:41:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:45 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.info Jul 07 22:41:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1e8d7d5a-453a-4d82-9b2c-49ffe272ac8d tempest-ProjectReaderTests-2030105988 None] Lock "cinder-5623792a-3bfc-43e0-ba35-25e0a969de66-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:45 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:45 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.info" returned: 0 in 0.749s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:45 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.info is being set with open permissions: ugo+rw Jul 07 22:41:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:45 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.info Jul 07 22:41:45 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:46 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.info" returned: 0 in 0.718s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.824s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.723s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-743af3d2-5967-468e-872b-f88edcdf0802-f1d4f1a9-5da4-4475-9f2d-03716290576a" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-743af3d2-5967-468e-872b-f88edcdf0802-f1d4f1a9-5da4-4475-9f2d-03716290576a" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Creating volume f1d4f1a9-5da4-4475-9f2d-03716290576a from snapshot 743af3d2-5967-468e-872b-f88edcdf0802 {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-f1d4f1a9-5da4-4475-9f2d-03716290576a" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:46 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-64100c66-64e0-4f63-81f0-62225dc41dd7 tempest-CinderUnicodeTest-249690754 None] Create snapshot completed successfully Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-f1d4f1a9-5da4-4475-9f2d-03716290576a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] snapshot: 743af3d2-5967-468e-872b-f88edcdf0802, volume: f1d4f1a9-5da4-4475-9f2d-03716290576a, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[02388a6c-be53-443d-8665-34228a108784]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:47 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 Jul 07 22:41:47 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Acquiring lock "cinder-e2a597e7-b3d3-42ab-9761-f589e5bbe05f-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Lock "cinder-e2a597e7-b3d3-42ab-9761-f589e5bbe05f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Acquiring lock "cinder-quobyte-d04effa7-e118-42d6-9d44-c1a7a8c63c90" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Lock "cinder-quobyte-d04effa7-e118-42d6-9d44-c1a7a8c63c90" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Acquiring lock "cinder-quobyte-e2a597e7-b3d3-42ab-9761-f589e5bbe05f" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Lock "cinder-quobyte-e2a597e7-b3d3-42ab-9761-f589e5bbe05f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Deleting offline snapshot e2a597e7-b3d3-42ab-9761-f589e5bbe05f of volume d04effa7-e118-42d6-9d44-c1a7a8c63c90 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] snapshot_file for this snap is: volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4bc947-ab86-49b9-b85b-df93dcffd868]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:47 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f Jul 07 22:41:47 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Flow 'volume_create_manager' (a0319f29-a016-456e-8837-60627045467c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cdc21b5-b5ea-49c9-9301-7f460a284913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:47 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802" returned: 0 in 1.093s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657ae111-0f14-41e1-8641-090046354b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cdc21b5-b5ea-49c9-9301-7f460a284913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141302195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f34b53-b74a-4a1d-a37f-370749804f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f53934fa9a140b5980caee3cf42323c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:48Z,use_quota=True,user_id='a0edf95aa8484a6d8faf16c0260b999a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56470c51-4543-4986-b4fd-c72f3a75681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56470c51-4543-4986-b4fd-c72f3a75681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22839cb3-ead5-4441-a26d-e8323db909f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22839cb3-ead5-4441-a26d-e8323db909f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f34b53-b74a-4a1d-a37f-370749804f9f', 'volume_name': 'volume-d3f34b53-b74a-4a1d-a37f-370749804f9f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99cd804-8519-4cdc-a9f2-76e407c2ba37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99cd804-8519-4cdc-a9f2-76e407c2ba37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013a6570-c30b-47ff-8c03-6258b5dfb609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:48 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Volume d3f34b53-b74a-4a1d-a37f-370749804f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f34b53-b74a-4a1d-a37f-370749804f9f', 'volume_size': 1} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f89f61-aefd-4109-b86c-8bebb1c656aa]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:48 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 Jul 07 22:41:48 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:48 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f" returned: 0 in 1.067s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbccbaa-d994-41e5-a608-67e71932f18a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:48 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 Jul 07 22:41:48 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:48 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28" returned: 0 in 0.822s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:41:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:48 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a Jul 07 22:41:48 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:49 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90" returned: 0 in 0.910s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:49 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f Jul 07 22:41:49 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:50 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f" returned: 0 in 1.128s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:50 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f Jul 07 22:41:50 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:51 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90.e2a597e7-b3d3-42ab-9761-f589e5bbe05f" returned: 0 in 1.283s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Lock "cinder-quobyte-e2a597e7-b3d3-42ab-9761-f589e5bbe05f" released by "_delete_snapshot" :: held 4.615s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Lock "cinder-quobyte-d04effa7-e118-42d6-9d44-c1a7a8c63c90" released by "delete_snapshot" :: held 4.652s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:51 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Created reservations ['5ada1e99-7e47-44ca-adfc-8c4e2894d5d6', 'f923c52f-496c-4e8c-853f-17d9bcfb9f70', '6b44e047-b9b3-4515-b430-214fc1d6ee75', '40804138-3b4e-4536-9673-74ce140da4d1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:52 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Delete snapshot completed successfully. Jul 07 22:41:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-51499c4d-4b53-4eb2-87d3-b152942aa74f tempest-CinderUnicodeTest-249690754 None] Lock "cinder-e2a597e7-b3d3-42ab-9761-f589e5bbe05f-delete_snapshot" released by "delete_snapshot" :: held 5.010s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "cinder-d04effa7-e118-42d6-9d44-c1a7a8c63c90-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Lock "cinder-d04effa7-e118-42d6-9d44-c1a7a8c63c90-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:52 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=166,cinder:SELECT=125,cinder:INSERT=36,cinder:DELETE=13 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:41:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "cinder-quobyte-d04effa7-e118-42d6-9d44-c1a7a8c63c90" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Lock "cinder-quobyte-d04effa7-e118-42d6-9d44-c1a7a8c63c90" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:53 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c2e489-102e-4b0e-a1d4-005583192827]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:53 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 Jul 07 22:41:53 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:54 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a" returned: 0 in 5.664s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:54 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd7140b-a719-4d8c-afb2-d5f291699ea4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:54 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 Jul 07 22:41:54 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:54 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90" returned: 0 in 1.764s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:54 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90 Jul 07 22:41:54 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:55 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04effa7-e118-42d6-9d44-c1a7a8c63c90" returned: 0 in 0.720s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Lock "cinder-quobyte-d04effa7-e118-42d6-9d44-c1a7a8c63c90" released by "delete_volume" :: held 2.617s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:55 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28" returned: 0 in 1.044s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:41:55 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Converted 1024.00 MB image at 180.75 MB/s Jul 07 22:41:55 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a is being set with open permissions: ugo+rw Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:55 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a Jul 07 22:41:55 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Created reservations ['cffba567-8c8f-4bc3-96af-b097abe50a72', 'cda0cb5d-ed1d-4922-bd9c-f0eea636d4e8', '1309fc12-7f45-4a2c-a48d-61972b388398', '57702393-f6a8-427c-826c-1fc3f55427c9'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:55 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:55 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:55 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:55 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "cinder-c67495e2-de28-488b-acda-531d66e75f7b-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Lock "cinder-c67495e2-de28-488b-acda-531d66e75f7b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:56 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a" returned: 0 in 0.785s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-f1d4f1a9-5da4-4475-9f2d-03716290576a" released by "_copy_volume_from_snapshot" :: held 9.624s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-743af3d2-5967-468e-872b-f88edcdf0802-f1d4f1a9-5da4-4475-9f2d-03716290576a" released by "_create_volume_from_snapshot" :: held 9.683s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.724s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.431s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891567206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ccbcdd-2d6f-435f-9187-ae295b7963e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f9c52557ca4d9fb7104ed08ce0a04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:45Z,use_quota=True,user_id='b8d0f664b04d456e9458da8e4a28146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Creating volume e8ccbcdd-2d6f-435f-9187-ae295b7963e8 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:56 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:56 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 1073741824 Jul 07 22:41:56 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "cinder-quobyte-c67495e2-de28-488b-acda-531d66e75f7b" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0cfbb2-ee0c-4be5-9b72-b789608f0f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d4f1a9-5da4-4475-9f2d-03716290576a', 'volume_size': 1, 'snapshot_id': '743af3d2-5967-468e-872b-f88edcdf0802'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25df040-8bff-4141-9ced-a049e9714d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Lock "cinder-quobyte-c67495e2-de28-488b-acda-531d66e75f7b" acquired by "delete_volume" :: waited 0.050s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:56 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Volume volume-f1d4f1a9-5da4-4475-9f2d-03716290576a (f1d4f1a9-5da4-4475-9f2d-03716290576a): created successfully Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25df040-8bff-4141-9ced-a049e9714d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Flow 'volume_create_manager' (4b0f1a7e-72ce-4543-8d3d-31f1e1b1638a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb5ca4-a433-402a-b25c-3d130ca4f1bd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:56 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:56 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.846s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.953s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Deleted volume successfully. Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:41:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4a8b6421-aa06-4373-beaa-8a9c7be95b8e tempest-VolumesSnapshotTestJSON-1005451233 None] Created volume successfully. Jul 07 22:41:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a4e01c4e-f262-491c-98f4-f8e913570ca8 tempest-CinderUnicodeTest-249690754 None] Lock "cinder-d04effa7-e118-42d6-9d44-c1a7a8c63c90-delete_volume" released by "delete_volume" :: held 3.898s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:56 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b Jul 07 22:41:56 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:57 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 1073741824" returned: 0 in 1.026s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:57 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 Jul 07 22:41:57 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:57 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b" returned: 0 in 1.006s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:57 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b Jul 07 22:41:57 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-f1d4f1a9-5da4-4475-9f2d-03716290576a-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-f1d4f1a9-5da4-4475-9f2d-03716290576a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-f1d4f1a9-5da4-4475-9f2d-03716290576a" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-f1d4f1a9-5da4-4475-9f2d-03716290576a" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aba2a6-9cfd-4fb5-8e8d-c7c20d5981ab]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:57 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a Jul 07 22:41:57 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:58 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8" returned: 0 in 0.834s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.331s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141302195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f34b53-b74a-4a1d-a37f-370749804f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f53934fa9a140b5980caee3cf42323c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:48Z,use_quota=True,user_id='a0edf95aa8484a6d8faf16c0260b999a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Creating volume d3f34b53-b74a-4a1d-a37f-370749804f9f {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:41:58 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3def5f-ec1a-4369-8b32-bfdcc32ae192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:58 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4442c7c5-4b47-4a73-b6ae-8a51e93669c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:41:58 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f 1073741824 Jul 07 22:41:58 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c67495e2-de28-488b-acda-531d66e75f7b" returned: 0 in 0.799s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Lock "cinder-quobyte-c67495e2-de28-488b-acda-531d66e75f7b" released by "delete_volume" :: held 1.916s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:58 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Volume volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 (e8ccbcdd-2d6f-435f-9187-ae295b7963e8): created successfully Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4442c7c5-4b47-4a73-b6ae-8a51e93669c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Flow 'volume_create_manager' (c11cdf96-24ef-45d8-9106-303bc15a84e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:41:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-62be39d1-0eec-489c-a002-89e33e3359a2 tempest-ProjectReaderTests-2030105988 None] Created volume successfully. Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Created reservations ['566004cf-a2e2-4641-b1b6-0e8798636d4d', 'a73eb358-19d2-4fe2-b865-71ae537009c9', 'fd5c0760-2124-4303-b446-0b4126389195', '74425e81-350a-4089-a567-7d810fe7521e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:58 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:41:58 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:58 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a" returned: 0 in 1.005s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:58 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a Jul 07 22:41:58 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "cinder-e8ccbcdd-2d6f-435f-9187-ae295b7963e8-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-e8ccbcdd-2d6f-435f-9187-ae295b7963e8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "cinder-quobyte-e8ccbcdd-2d6f-435f-9187-ae295b7963e8" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-quobyte-e8ccbcdd-2d6f-435f-9187-ae295b7963e8" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b2f147-46b2-4ac2-a493-dcef1ba8a017]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:59 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f 1073741824" returned: 0 in 1.128s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:41:59 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 Jul 07 22:41:59 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:59 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f Jul 07 22:41:59 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:41:59 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.930s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:41:59 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Deleted volume successfully. Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cfd3d444-5c66-4f68-9cf6-ca1dae6885b1 tempest-CinderUnicodeTest-249690754 None] Lock "cinder-c67495e2-de28-488b-acda-531d66e75f7b-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:59 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d4f1a9-5da4-4475-9f2d-03716290576a" returned: 0 in 0.886s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-f1d4f1a9-5da4-4475-9f2d-03716290576a" released by "delete_volume" :: held 1.946s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Created reservations ['fb90182a-d0a3-4b15-97f1-75637db27780', '1c95f345-7802-4dc1-b283-6a1106333095', '09e7abcd-7fd8-4318-8717-76fcd7193cb3', '650e209d-8acc-4f7c-b948-5cd73ec625b0'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:41:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:00 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:42:00 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-743af3d2-5967-468e-872b-f88edcdf0802-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-743af3d2-5967-468e-872b-f88edcdf0802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-657ae111-0f14-41e1-8641-090046354b28" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-657ae111-0f14-41e1-8641-090046354b28" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-743af3d2-5967-468e-872b-f88edcdf0802" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-743af3d2-5967-468e-872b-f88edcdf0802" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Deleting offline snapshot 743af3d2-5967-468e-872b-f88edcdf0802 of volume 657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] snapshot_file for this snap is: volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[41838799-541e-4c38-b6b0-42d0293acf61]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:00 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 Jul 07 22:42:00 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:00 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8" returned: 0 in 1.139s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:00 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8 Jul 07 22:42:00 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:00 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f" returned: 0 in 1.263s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.464s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013a6570-c30b-47ff-8c03-6258b5dfb609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f34b53-b74a-4a1d-a37f-370749804f9f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd893faa-2d9a-4453-ac45-dac908135d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:00 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Volume volume-d3f34b53-b74a-4a1d-a37f-370749804f9f (d3f34b53-b74a-4a1d-a37f-370749804f9f): created successfully Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd893faa-2d9a-4453-ac45-dac908135d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Flow 'volume_create_manager' (a0319f29-a016-456e-8837-60627045467c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a9cd0d71-08c8-45de-a969-a5aad0f543b2 tempest-ProjectReaderTests-615261422 None] Created volume successfully. Jul 07 22:42:00 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.015s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:00 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:01 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Deleted volume successfully. Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b5e12495-b684-4f46-9cc9-56902e7ead91 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-f1d4f1a9-5da4-4475-9f2d-03716290576a-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:01 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802" returned: 0 in 1.431s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657ae111-0f14-41e1-8641-090046354b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d2cbf9-8eab-4d9a-883a-c77409f9b530]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Acquiring lock "cinder-d3f34b53-b74a-4a1d-a37f-370749804f9f-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Lock "cinder-d3f34b53-b74a-4a1d-a37f-370749804f9f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:01 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e8ccbcdd-2d6f-435f-9187-ae295b7963e8" returned: 0 in 1.213s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-quobyte-e8ccbcdd-2d6f-435f-9187-ae295b7963e8" released by "delete_volume" :: held 2.429s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:01 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 Jul 07 22:42:01 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Acquiring lock "cinder-quobyte-d3f34b53-b74a-4a1d-a37f-370749804f9f" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Lock "cinder-quobyte-d3f34b53-b74a-4a1d-a37f-370749804f9f" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d26693e-9656-497d-80ee-c24fb6a79576]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:01 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Created reservations ['306a7bfd-e893-4dc5-acd5-9f078e8f78bc', '35e60ac3-ae2c-4612-a7d3-df2d7cc8ad55', '4d8e37cf-618c-426f-bee2-6f95d58ec2b6', '9b966627-4d6e-4390-a757-afadf91bbb16'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:02 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f Jul 07 22:42:02 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:02 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:42:02 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:02 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28" returned: 0 in 1.086s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:02 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 Jul 07 22:42:02 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:02 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.869s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:02 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Deleted volume successfully. Jul 07 22:42:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a052a254-2358-4f9e-92f1-204c4d5bd529 tempest-ProjectReaderTests-2030105988 None] Lock "cinder-e8ccbcdd-2d6f-435f-9187-ae295b7963e8-delete_volume" released by "delete_volume" :: held 3.678s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:03 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f" returned: 0 in 1.124s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:03 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f Jul 07 22:42:03 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:03 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d3f34b53-b74a-4a1d-a37f-370749804f9f" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:03 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802" returned: 0 in 1.047s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Lock "cinder-quobyte-d3f34b53-b74a-4a1d-a37f-370749804f9f" released by "delete_volume" :: held 1.969s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:03 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802 Jul 07 22:42:03 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:03 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Created reservations ['11ef2548-b097-48b4-8495-33c431b8d39e', '8abf02dd-77a9-4d62-a832-c3592ef58334', 'f874dab6-a1c6-47b4-b18d-625f3d5ffc71', '8b9c6879-c349-4bb4-9055-77e726e5741b'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:04 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:42:04 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:04 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28.743af3d2-5967-468e-872b-f88edcdf0802" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-743af3d2-5967-468e-872b-f88edcdf0802" released by "_delete_snapshot" :: held 4.597s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-657ae111-0f14-41e1-8641-090046354b28" released by "delete_snapshot" :: held 4.635s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Flow 'volume_create_manager' (7f91d950-552e-49ef-9cc8-688ef585c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cff75ab-0cd4-40e1-b537-bcafda6b193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:04 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.845s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cff75ab-0cd4-40e1-b537-bcafda6b193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1936514778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803e1d1f-a85f-45ac-a283-c9ee91246684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f53934fa9a140b5980caee3cf42323c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:05Z,use_quota=True,user_id='a0edf95aa8484a6d8faf16c0260b999a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa64182e-ee18-43f2-b961-df7042081489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa64182e-ee18-43f2-b961-df7042081489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6774dfbe-f6db-4ab8-9ff8-401fdfe60105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6774dfbe-f6db-4ab8-9ff8-401fdfe60105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803e1d1f-a85f-45ac-a283-c9ee91246684', 'volume_name': 'volume-803e1d1f-a85f-45ac-a283-c9ee91246684', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a312cb-7648-47ad-b83a-3af55dcaf9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a312cb-7648-47ad-b83a-3af55dcaf9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfb7ed6-ddce-4281-a9a2-4f44ff7d045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Volume 803e1d1f-a85f-45ac-a283-c9ee91246684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803e1d1f-a85f-45ac-a283-c9ee91246684', 'volume_size': 1} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1936514778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803e1d1f-a85f-45ac-a283-c9ee91246684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f53934fa9a140b5980caee3cf42323c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:05Z,use_quota=True,user_id='a0edf95aa8484a6d8faf16c0260b999a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Creating volume 803e1d1f-a85f-45ac-a283-c9ee91246684 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:04 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:42:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Deleted volume successfully. Jul 07 22:42:05 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 1073741824 Jul 07 22:42:05 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-63e2143d-7ac2-4a69-a189-ca6c62123a98 tempest-ProjectReaderTests-615261422 None] Lock "cinder-d3f34b53-b74a-4a1d-a37f-370749804f9f-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Created reservations ['c11f3116-3eea-4c35-b18f-3058038a6447', '28fc7955-9aec-4321-81e3-aa24a9895c55', '89a057f4-2930-48e4-8a83-8742bcd70317', '25bda4cc-855d-4ce9-903f-86b447f42207'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Delete snapshot completed successfully. Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-35fa808b-846d-4b4d-8919-1abb442b8603 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-743af3d2-5967-468e-872b-f88edcdf0802-delete_snapshot" released by "delete_snapshot" :: held 5.099s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-657ae111-0f14-41e1-8641-090046354b28-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-657ae111-0f14-41e1-8641-090046354b28-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-657ae111-0f14-41e1-8641-090046354b28" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-657ae111-0f14-41e1-8641-090046354b28" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b248433-b50e-4deb-ba53-f5520643592b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:05 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 Jul 07 22:42:05 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:06 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 1073741824" returned: 0 in 1.119s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:06 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 Jul 07 22:42:06 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:06 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28" returned: 0 in 1.029s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:06 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28 Jul 07 22:42:06 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:07 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684" returned: 0 in 0.869s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfb7ed6-ddce-4281-a9a2-4f44ff7d045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803e1d1f-a85f-45ac-a283-c9ee91246684', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65314208-ab4d-4631-940e-86a5f74d79fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Volume volume-803e1d1f-a85f-45ac-a283-c9ee91246684 (803e1d1f-a85f-45ac-a283-c9ee91246684): created successfully Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65314208-ab4d-4631-940e-86a5f74d79fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Flow 'volume_create_manager' (7f91d950-552e-49ef-9cc8-688ef585c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-df037385-aa4d-4af1-8b44-ee429120cc96 tempest-ProjectReaderTests-615261422 None] Created volume successfully. Jul 07 22:42:07 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-657ae111-0f14-41e1-8641-090046354b28" returned: 0 in 0.890s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-657ae111-0f14-41e1-8641-090046354b28" released by "delete_volume" :: held 2.000s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:07 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Created reservations ['d0bdde37-8f72-442d-af12-2e86ccb75370', '12cf7824-9f47-438b-96b2-1dbd5ae7d84d', 'ada4adb1-edfb-471a-abf6-1f1e7f9d569c', 'd54fe9b1-41ec-4341-a1b3-d0b0b43618da'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:08 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:42:08 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Acquiring lock "cinder-803e1d1f-a85f-45ac-a283-c9ee91246684-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Lock "cinder-803e1d1f-a85f-45ac-a283-c9ee91246684-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Acquiring lock "cinder-quobyte-803e1d1f-a85f-45ac-a283-c9ee91246684" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Lock "cinder-quobyte-803e1d1f-a85f-45ac-a283-c9ee91246684" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d250afb-d301-473e-b060-867aa8d059a9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:08 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 Jul 07 22:42:08 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:08 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.785s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Deleted volume successfully. Jul 07 22:42:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-91c59bf4-9462-4455-b7a3-81a28cd49b83 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-657ae111-0f14-41e1-8641-090046354b28-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-77c304d0-3bca-41af-80ed-64014e8ba024-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-77c304d0-3bca-41af-80ed-64014e8ba024-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:09 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "cinder-quobyte-77c304d0-3bca-41af-80ed-64014e8ba024" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684" returned: 0 in 0.965s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:09 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684 Jul 07 22:42:09 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-77c304d0-3bca-41af-80ed-64014e8ba024" acquired by "delete_volume" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19fd800-b98e-4ffe-b910-aa9a28bf945e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:09 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 Jul 07 22:42:09 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:09 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-803e1d1f-a85f-45ac-a283-c9ee91246684" returned: 0 in 0.765s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Lock "cinder-quobyte-803e1d1f-a85f-45ac-a283-c9ee91246684" released by "delete_volume" :: held 1.791s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Created reservations ['33289932-8e53-4dd0-92e1-aa19a8273364', 'e6385594-944f-493c-8344-44bc9dbb8892', '10795c2f-4b06-4930-a994-faa86ff0a094', '3ada2c01-402e-4373-9250-e860ad04ad7a'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:10 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:42:10 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:10 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024" returned: 0 in 0.971s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:10 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024 Jul 07 22:42:10 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:11 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.960s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Deleted volume successfully. Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87bcbd70-dbf3-4542-b9e3-7c1d9679d3d3 tempest-ProjectReaderTests-615261422 None] Lock "cinder-803e1d1f-a85f-45ac-a283-c9ee91246684-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:11 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-77c304d0-3bca-41af-80ed-64014e8ba024" returned: 0 in 0.962s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-quobyte-77c304d0-3bca-41af-80ed-64014e8ba024" released by "delete_volume" :: held 2.029s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Created reservations ['64c7271d-5a12-4b04-b18b-de655f60b8a2', '88c553a5-d74a-4a5a-a549-5f8a8ca7edab', '73db83b4-0b7e-4bb8-b209-d763dfdb1976', 'b9854a7a-d3bd-4c9c-8948-29e89d6e06f0'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:11 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:42:11 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:12 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.821s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:12 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Deleted volume successfully. Jul 07 22:42:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ff4c8965-b8fb-431a-8d95-824bc99d7f02 tempest-VolumesSnapshotTestJSON-1005451233 None] Lock "cinder-77c304d0-3bca-41af-80ed-64014e8ba024-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:42:21 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=84,cinder:INSERT=30,cinder:UPDATE=125,cinder:DELETE=11 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:42:22 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=49,cinder:INSERT=23,cinder:UPDATE=77,cinder:DELETE=4 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Flow 'volume_create_manager' (8f133e85-93b8-412a-8097-02aced2ff0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5128ada-c5d0-4e4f-98ad-88b0d6c18fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5128ada-c5d0-4e4f-98ad-88b0d6c18fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795024907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2ad6c4-a2e8-48e8-87dc-68eb24d18659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb33139fc6a340c697d6706eb9411474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:39Z,use_quota=True,user_id='107e83ca41b148819b791f53916217cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a16048-c1a4-4dbf-863d-817f325493e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a16048-c1a4-4dbf-863d-817f325493e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6bdb8ab-fe6a-4ae1-a22a-f912ea84b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6bdb8ab-fe6a-4ae1-a22a-f912ea84b131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2ad6c4-a2e8-48e8-87dc-68eb24d18659', 'volume_name': 'volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eff821a-2ce5-440d-bb31-0094b323bb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eff821a-2ce5-440d-bb31-0094b323bb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f662a3-3bf6-4eb8-a611-19640ca6e9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:38 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Volume 5b2ad6c4-a2e8-48e8-87dc-68eb24d18659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659', 'volume_size': 1} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795024907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2ad6c4-a2e8-48e8-87dc-68eb24d18659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb33139fc6a340c697d6706eb9411474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:39Z,use_quota=True,user_id='107e83ca41b148819b791f53916217cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Creating volume 5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:38 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:42:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:38 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 1073741824 Jul 07 22:42:38 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:39 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 1073741824" returned: 0 in 1.067s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:39 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 Jul 07 22:42:39 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:40 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" returned: 0 in 0.915s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f662a3-3bf6-4eb8-a611-19640ca6e9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6e15a4-16d1-412c-a8c9-20f52dad5be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:40 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Volume volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 (5b2ad6c4-a2e8-48e8-87dc-68eb24d18659): created successfully Jul 07 22:42:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6e15a4-16d1-412c-a8c9-20f52dad5be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Flow 'volume_create_manager' (8f133e85-93b8-412a-8097-02aced2ff0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d6554bc6-77e5-4fae-a9eb-2fd8966716f0 tempest-SnapshotDependencyTests-761248341 None] Created volume successfully. Jul 07 22:42:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Creating offline snapshot d35f0022-879f-440e-8cbf-65725c7ed5eb of volume 5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:42:42 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e45f95-0771-4a44-bc5c-b2d3c5fd3345]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:42 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 Jul 07 22:42:42 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:43 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" returned: 0 in 1.123s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:43 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb 1G Jul 07 22:42:43 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:44 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb 1G" returned: 0 in 1.064s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:44 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb Jul 07 22:42:44 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:45 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb" returned: 0 in 0.731s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:45 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb is being set with open permissions: ugo+rw Jul 07 22:42:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:45 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb Jul 07 22:42:45 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:45 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb" returned: 0 in 0.850s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:46 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.info Jul 07 22:42:46 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:46 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.info" returned: 0 in 0.748s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:46 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.info is being set with open permissions: ugo+rw Jul 07 22:42:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:46 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.info Jul 07 22:42:46 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Flow 'volume_create_manager' (7b6e7c25-026f-4930-9eae-3465e814d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03631c7b-dfe4-4d97-87a6-6cf790add30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03631c7b-dfe4-4d97-87a6-6cf790add30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1033200085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5980cd05-d0a8-478b-bc34-62b22d4f1c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0dd391dcfb44f8ba5c96e5db411a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:47Z,use_quota=True,user_id='1820c834838146d6839b75e0fdc8c2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13efdd5-f78b-495e-b306-e6095deacfb9),volume_type_id=c13efdd5-f78b-495e-b306-e6095deacfb9)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a5684d-6cb1-45bb-b960-248355912f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a5684d-6cb1-45bb-b960-248355912f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bb5ff7-473c-426b-9c7b-c3b45d9f365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bb5ff7-473c-426b-9c7b-c3b45d9f365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5980cd05-d0a8-478b-bc34-62b22d4f1c7c', 'volume_name': 'volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac483342-d673-455a-905c-2d0a1f95fa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac483342-d673-455a-905c-2d0a1f95fa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fc035c-900f-431e-b811-307f6e275f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:47 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Volume 5980cd05-d0a8-478b-bc34-62b22d4f1c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c', 'volume_size': 1} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:47 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.info" returned: 0 in 0.858s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.477s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1033200085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5980cd05-d0a8-478b-bc34-62b22d4f1c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0dd391dcfb44f8ba5c96e5db411a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:47Z,use_quota=True,user_id='1820c834838146d6839b75e0fdc8c2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13efdd5-f78b-495e-b306-e6095deacfb9),volume_type_id=c13efdd5-f78b-495e-b306-e6095deacfb9)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Creating volume 5980cd05-d0a8-478b-bc34-62b22d4f1c7c {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:47 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:42:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:47 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-35e2f74b-11c1-4b15-a098-47d1810a9b20 tempest-SnapshotDependencyTests-761248341 None] Create snapshot completed successfully Jul 07 22:42:47 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c 1073741824 Jul 07 22:42:47 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Flow 'volume_create_manager' (8bc76db2-7836-467a-a3e0-18495fdfa807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf095a28-7d1d-4f26-9f5e-8f0b568c634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf095a28-7d1d-4f26-9f5e-8f0b568c634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1345341837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25261e73-16cf-4d44-a26e-d8d9e09fb7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0dd391dcfb44f8ba5c96e5db411a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:48Z,use_quota=True,user_id='1820c834838146d6839b75e0fdc8c2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(140ae255-61a3-459c-a38b-4828e2786ec9),volume_type_id=140ae255-61a3-459c-a38b-4828e2786ec9)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b9671f-32c9-416a-8757-0630c0033247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b9671f-32c9-416a-8757-0630c0033247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c652b3fb-68a6-4865-8b85-f9deb241c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c652b3fb-68a6-4865-8b85-f9deb241c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25261e73-16cf-4d44-a26e-d8d9e09fb7b1', 'volume_name': 'volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fafbe54-5231-4efd-b8e5-8c50d1f6a283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fafbe54-5231-4efd-b8e5-8c50d1f6a283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c96e04-e37a-4ec7-ab7a-cb47438b1f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Volume 25261e73-16cf-4d44-a26e-d8d9e09fb7b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1', 'volume_size': 1} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:48 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c 1073741824" returned: 0 in 1.183s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Flow 'volume_create_manager' (42a3c2c6-e706-42cd-9852-41d539d0cc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe847f13-e720-4368-a544-1b2d7c531f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe847f13-e720-4368-a544-1b2d7c531f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1832546331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59139a0e-ff24-4105-a152-3b65f6813a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0dd391dcfb44f8ba5c96e5db411a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:49Z,use_quota=True,user_id='1820c834838146d6839b75e0fdc8c2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa5368c7-4bb4-4128-a8aa-ddb1adba0cb1),volume_type_id=fa5368c7-4bb4-4128-a8aa-ddb1adba0cb1)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51311881-0049-44b9-a132-48683f6d72be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51311881-0049-44b9-a132-48683f6d72be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648b1c53-c97f-4fa3-8a69-7da136eaae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:42:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:48 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c Jul 07 22:42:48 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Flow 'volume_create_manager' (a7b91e67-2e39-49a5-8e9b-a5349770b37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f39e72-d94e-4aed-9456-2398d0173e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f39e72-d94e-4aed-9456-2398d0173e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24956afe-10e5-4866-953e-a915b7730c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb33139fc6a340c697d6706eb9411474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d35f0022-879f-440e-8cbf-65725c7ed5eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:49Z,use_quota=True,user_id='107e83ca41b148819b791f53916217cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7353b1-36fc-4981-9a61-32aca48a76a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7353b1-36fc-4981-9a61-32aca48a76a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b33089-5c8e-459d-8d3f-930c8222ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b33089-5c8e-459d-8d3f-930c8222ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24956afe-10e5-4866-953e-a915b7730c84', 'volume_name': 'volume-24956afe-10e5-4866-953e-a915b7730c84', 'volume_size': 1, 'snapshot_id': 'd35f0022-879f-440e-8cbf-65725c7ed5eb'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da4b117-71bf-4b5d-af6f-c804e23ef29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da4b117-71bf-4b5d-af6f-c804e23ef29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530486e6-94ad-480a-8251-d18926bdb16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:49 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Volume 24956afe-10e5-4866-953e-a915b7730c84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24956afe-10e5-4866-953e-a915b7730c84', 'volume_size': 1, 'snapshot_id': 'd35f0022-879f-440e-8cbf-65725c7ed5eb'} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648b1c53-c97f-4fa3-8a69-7da136eaae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59139a0e-ff24-4105-a152-3b65f6813a17', 'volume_name': 'volume-59139a0e-ff24-4105-a152-3b65f6813a17', 'volume_size': 1, 'image_id': 'bb854476-1162-4449-a3e9-a3e9acdca827', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb854476-1162-4449-a3e9-a3e9acdca827', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1375068982', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca0dd391dcfb44f8ba5c96e5db411a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb854476-1162-4449-a3e9-a3e9acdca827', 'created_at': datetime.datetime(2026, 7, 7, 20, 42, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 42, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb854476-1162-4449-a3e9-a3e9acdca827/file', 'properties': {}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8a1981-da1e-4702-b0dd-4c1cd3408b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8a1981-da1e-4702-b0dd-4c1cd3408b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4ae321-5b62-478d-9ff8-3acf0a5f27c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:49 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Volume 59139a0e-ff24-4105-a152-3b65f6813a17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59139a0e-ff24-4105-a152-3b65f6813a17', 'volume_size': 1, 'image_id': 'bb854476-1162-4449-a3e9-a3e9acdca827', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb854476-1162-4449-a3e9-a3e9acdca827', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1375068982', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca0dd391dcfb44f8ba5c96e5db411a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb854476-1162-4449-a3e9-a3e9acdca827', 'created_at': datetime.datetime(2026, 7, 7, 20, 42, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 42, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb854476-1162-4449-a3e9-a3e9acdca827/file', 'properties': {}}, 'image_service': } Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Trying to clone 59139a0e-ff24-4105-a152-3b65f6813a17 from image bb854476-1162-4449-a3e9-a3e9acdca827 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb854476-1162-4449-a3e9-a3e9acdca827', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:42:49 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c" returned: 0 in 0.940s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1345341837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25261e73-16cf-4d44-a26e-d8d9e09fb7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0dd391dcfb44f8ba5c96e5db411a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:48Z,use_quota=True,user_id='1820c834838146d6839b75e0fdc8c2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(140ae255-61a3-459c-a38b-4828e2786ec9),volume_type_id=140ae255-61a3-459c-a38b-4828e2786ec9)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Creating volume 25261e73-16cf-4d44-a26e-d8d9e09fb7b1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:49 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:49 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 1073741824 Jul 07 22:42:49 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fc035c-900f-431e-b811-307f6e275f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f3466b-4a9d-454f-8b12-927cdd644fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:49 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Volume volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c (5980cd05-d0a8-478b-bc34-62b22d4f1c7c): created successfully Jul 07 22:42:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f3466b-4a9d-454f-8b12-927cdd644fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Flow 'volume_create_manager' (7b6e7c25-026f-4930-9eae-3465e814d953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-fbfc003f-7a11-4569-83d6-dcc7e0fddacb tempest-TestInstancesWithCinderVolumes-72868576 None] Created volume successfully. Jul 07 22:42:50 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 1073741824" returned: 0 in 0.956s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:50 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 Jul 07 22:42:50 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:51 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1" returned: 0 in 0.775s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.202s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-quobyte-d35f0022-879f-440e-8cbf-65725c7ed5eb-24956afe-10e5-4866-953e-a915b7730c84" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-d35f0022-879f-440e-8cbf-65725c7ed5eb-24956afe-10e5-4866-953e-a915b7730c84" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Creating volume 24956afe-10e5-4866-953e-a915b7730c84 from snapshot d35f0022-879f-440e-8cbf-65725c7ed5eb {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-quobyte-24956afe-10e5-4866-953e-a915b7730c84" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c96e04-e37a-4ec7-ab7a-cb47438b1f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77386b80-8c46-4dd3-a9dc-eb88068c91c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-24956afe-10e5-4866-953e-a915b7730c84" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] snapshot: d35f0022-879f-440e-8cbf-65725c7ed5eb, volume: 24956afe-10e5-4866-953e-a915b7730c84, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:42:51 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Volume volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 (25261e73-16cf-4d44-a26e-d8d9e09fb7b1): created successfully Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77386b80-8c46-4dd3-a9dc-eb88068c91c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Flow 'volume_create_manager' (8bc76db2-7836-467a-a3e0-18495fdfa807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:51 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-28419a0f-1446-402b-a2ea-31a9cd5266ec tempest-TestInstancesWithCinderVolumes-72868576 None] Created volume successfully. Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c8dd72-844d-4c55-aea9-c0a7f0769278]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:51 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb Jul 07 22:42:51 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:52 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb" returned: 0 in 0.882s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:42:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:42:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:42:52 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f6873f-0a2b-48f8-80b9-b2348f8ca13e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:52 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 Jul 07 22:42:52 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:53 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD, size 20.69 MB, duration 3.74 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:42:53 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Image download 20.69 MB at 5.54 MB/s Jul 07 22:42:53 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b620a88-a6a8-4bba-a490-9e2c6a18be5f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:53 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD Jul 07 22:42:53 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:53 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" returned: 0 in 0.876s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:53 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:42:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:53 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 Jul 07 22:42:53 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:54 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:54 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Temporary image bb854476-1162-4449-a3e9-a3e9acdca827 is fetched for user 1820c834838146d6839b75e0fdc8c2ed. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:42:54 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc44fa63-cfcd-45f1-bd90-84de9268db99]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:54 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD Jul 07 22:42:54 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:42:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:42:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:42:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:42:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:42:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:55 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:42:55 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:56 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD" returned: 0 in 1.949s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:42:57 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.518s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:42:57 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:42:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:42:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:42:58 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84" returned: 0 in 5.069s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[358d79fa-399e-4464-8a61-3a1286c25d0f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:42:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:58 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 Jul 07 22:42:58 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:42:59 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jul 07 22:42:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" returned: 0 in 1.010s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:42:59 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:42:59 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Converted 1024.00 MB image at 201.96 MB/s Jul 07 22:42:59 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 is being set with open permissions: ugo+rw Jul 07 22:42:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:42:59 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 Jul 07 22:42:59 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:00 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84" returned: 0 in 0.689s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-24956afe-10e5-4866-953e-a915b7730c84" released by "_copy_volume_from_snapshot" :: held 8.652s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-d35f0022-879f-440e-8cbf-65725c7ed5eb-24956afe-10e5-4866-953e-a915b7730c84" released by "_create_volume_from_snapshot" :: held 8.714s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.740s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.289s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1832546331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59139a0e-ff24-4105-a152-3b65f6813a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0dd391dcfb44f8ba5c96e5db411a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:49Z,use_quota=True,user_id='1820c834838146d6839b75e0fdc8c2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa5368c7-4bb4-4128-a8aa-ddb1adba0cb1),volume_type_id=fa5368c7-4bb4-4128-a8aa-ddb1adba0cb1)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Creating volume 59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:43:00 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:00 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 1073741824 Jul 07 22:43:00 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530486e6-94ad-480a-8251-d18926bdb16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24956afe-10e5-4866-953e-a915b7730c84', 'volume_size': 1, 'snapshot_id': 'd35f0022-879f-440e-8cbf-65725c7ed5eb'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36841756-6895-4cc0-8553-ffbcb1fe2796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:00 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Volume volume-24956afe-10e5-4866-953e-a915b7730c84 (24956afe-10e5-4866-953e-a915b7730c84): created successfully Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36841756-6895-4cc0-8553-ffbcb1fe2796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Flow 'volume_create_manager' (a7b91e67-2e39-49a5-8e9b-a5349770b37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-df4a0321-cf7a-42bd-a1bd-3189c20626dc tempest-SnapshotDependencyTests-761248341 None] Created volume successfully. Jul 07 22:43:01 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 1073741824" returned: 0 in 0.810s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:01 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:43:01 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-d35f0022-879f-440e-8cbf-65725c7ed5eb-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-d35f0022-879f-440e-8cbf-65725c7ed5eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-quobyte-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-quobyte-d35f0022-879f-440e-8cbf-65725c7ed5eb" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-d35f0022-879f-440e-8cbf-65725c7ed5eb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Deleting offline snapshot d35f0022-879f-440e-8cbf-65725c7ed5eb of volume 5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] snapshot_file for this snap is: volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[09146b81-edc5-4ea2-8c27-be15dbb00c0f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:01 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb Jul 07 22:43:01 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:01 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 0 in 0.689s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:43:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Attempting download of bb854476-1162-4449-a3e9-a3e9acdca827 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb854476-1162-4449-a3e9-a3e9acdca827', 'metadata': {}}])) to volume 59139a0e-ff24-4105-a152-3b65f6813a17. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c1d530-4026-4da1-a20f-ae2d1fda49fe]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb854476-1162-4449-a3e9-a3e9acdca827_4p3nhkva {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:02 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb854476-1162-4449-a3e9-a3e9acdca827_4p3nhkva Jul 07 22:43:02 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:02 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb" returned: 0 in 0.872s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de25632-90a2-4287-b1e7-90867e7798b9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:02 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 Jul 07 22:43:02 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:02 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb854476-1162-4449-a3e9-a3e9acdca827_4p3nhkva" returned: 0 in 0.825s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb854476-1162-4449-a3e9-a3e9acdca827_4p3nhkva {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:03 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb854476-1162-4449-a3e9-a3e9acdca827_4p3nhkva Jul 07 22:43:03 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:03 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" returned: 0 in 0.882s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:03 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb Jul 07 22:43:03 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:03 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb854476-1162-4449-a3e9-a3e9acdca827_4p3nhkva" returned: 1 in 0.766s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb854476-1162-4449-a3e9-a3e9acdca827_4p3nhkva' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:43:03 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd1566d-917c-402a-9ab2-a4127e6ecb98]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:03 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD Jul 07 22:43:03 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:04 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb" returned: 0 in 0.842s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:04 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb Jul 07 22:43:04 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:04 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:04 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] bb854476-1162-4449-a3e9-a3e9acdca827 was qcow2, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:43:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:04 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:43:04 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:04 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659.d35f0022-879f-440e-8cbf-65725c7ed5eb" returned: 0 in 0.694s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-d35f0022-879f-440e-8cbf-65725c7ed5eb" released by "_delete_snapshot" :: held 3.410s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" released by "delete_snapshot" :: held 3.434s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:05 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Created reservations ['d7c95244-d77a-4465-97f0-3349acd96746', 'b53d1f9d-abc2-483d-af41-81d1abb311d6', 'efb7944e-0cb8-4522-a789-305f322be035', '6cff09d4-289d-4317-90d6-a10744a7be3f'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Delete snapshot completed successfully. Jul 07 22:43:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81c34b64-6309-4c5d-b4ee-d43c7bb86601 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-d35f0022-879f-440e-8cbf-65725c7ed5eb-delete_snapshot" released by "delete_snapshot" :: held 3.637s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-quobyte-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:05 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c84b0-b0c1-4050-85ea-4a40fdd5d0f1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:06 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 Jul 07 22:43:06 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:06 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 0 in 2.068s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:06 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb854476-1162-4449-a3e9-a3e9acdca827_afqc0gvvdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:43:06 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Converted 112.00 MB image at 54.13 MB/s Jul 07 22:43:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:06 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 1G Jul 07 22:43:06 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:06 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" returned: 0 in 0.816s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:06 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659 Jul 07 22:43:06 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:07 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 1G" returned: 0 in 0.787s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e028926-3bc5-42fc-9c6b-00e7ec2d68b5]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:07 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" returned: 0 in 0.731s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659" released by "delete_volume" :: held 1.619s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Created reservations ['7562802f-c089-4a9f-aacf-ed539e0a2cbd', '7a4777d6-27dc-497d-a2bd-c02cd765e70b', 'fde48ddb-a458-468a-98b3-440e0d96072d', '0b6f3443-c162-4b88-826b-9230b57da5ae'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:07 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:43:07 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:07 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:43:07 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-24956afe-10e5-4866-953e-a915b7730c84-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-24956afe-10e5-4866-953e-a915b7730c84-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "cinder-quobyte-24956afe-10e5-4866-953e-a915b7730c84" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-24956afe-10e5-4866-953e-a915b7730c84" acquired by "delete_volume" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[591fe9e4-c996-431e-8211-35d33658ff58]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:08 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 0 in 0.817s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:08 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 Jul 07 22:43:08 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:08 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.753s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:08 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:43:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Deleted volume successfully. Jul 07 22:43:08 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e0ff2340-6063-4e01-b6ee-d79206e00098 tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-5b2ad6c4-a2e8-48e8-87dc-68eb24d18659-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:09 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84" returned: 0 in 0.829s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:09 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84 Jul 07 22:43:09 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:09 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 1 in 0.895s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Downloaded image bb854476-1162-4449-a3e9-a3e9acdca827 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb854476-1162-4449-a3e9-a3e9acdca827', 'metadata': {}}])) to volume 59139a0e-ff24-4105-a152-3b65f6813a17 successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Temporary image bb854476-1162-4449-a3e9-a3e9acdca827 for user 1820c834838146d6839b75e0fdc8c2ed is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Marking volume 59139a0e-ff24-4105-a152-3b65f6813a17 as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Copying metadata from image bb854476-1162-4449-a3e9-a3e9acdca827 to 59139a0e-ff24-4105-a152-3b65f6813a17. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Creating volume glance metadata for volume 59139a0e-ff24-4105-a152-3b65f6813a17 backed by image bb854476-1162-4449-a3e9-a3e9acdca827 with: {'image_id': 'bb854476-1162-4449-a3e9-a3e9acdca827', 'image_name': 'tempest-scenario-img--1375068982', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4ae321-5b62-478d-9ff8-3acf0a5f27c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59139a0e-ff24-4105-a152-3b65f6813a17', 'volume_size': 1, 'image_id': 'bb854476-1162-4449-a3e9-a3e9acdca827', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb854476-1162-4449-a3e9-a3e9acdca827', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1375068982', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca0dd391dcfb44f8ba5c96e5db411a7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb854476-1162-4449-a3e9-a3e9acdca827', 'created_at': datetime.datetime(2026, 7, 7, 20, 42, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 42, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb854476-1162-4449-a3e9-a3e9acdca827/file', 'properties': {}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8413acb-814d-452c-8e98-f10b6f36cebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:43:09 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Volume volume-59139a0e-ff24-4105-a152-3b65f6813a17 (59139a0e-ff24-4105-a152-3b65f6813a17): created successfully Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8413acb-814d-452c-8e98-f10b6f36cebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Flow 'volume_create_manager' (42a3c2c6-e706-42cd-9852-41d539d0cc7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:43:09 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ad32a8d1-b5a7-4af8-935e-ae3e81bce414 tempest-TestInstancesWithCinderVolumes-72868576 None] Created volume successfully. Jul 07 22:43:09 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-24956afe-10e5-4866-953e-a915b7730c84" returned: 0 in 0.741s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-quobyte-24956afe-10e5-4866-953e-a915b7730c84" released by "delete_volume" :: held 1.620s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Created reservations ['4fae7619-3256-4b79-ae9f-7a25fefffe7e', 'cf791ae4-3edf-4216-9dc9-35d77835209c', '360775c3-03da-4f6a-808b-68d0b0e8d1cc', '62a7e011-7ccd-49ac-81ba-5bd65666b851'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:09 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:43:09 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:10 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.714s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:10 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:43:10 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Deleted volume successfully. Jul 07 22:43:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-443cf56c-0bf9-49eb-85ca-be26603ddfdf tempest-SnapshotDependencyTests-761248341 None] Lock "cinder-24956afe-10e5-4866-953e-a915b7730c84-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:43:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:18 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca5852d-3e47-4b23-aab4-4e9676f1bd36]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:18 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:43:18 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:19 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 0 in 0.997s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:19 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:43:19 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:19 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 1 in 0.919s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:43:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.973s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-59139a0e-ff24-4105-a152-3b65f6813a17', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc2a2d32-0d87-4b33-a986-f14a6ff0bf99', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:43:20 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-1110a430-57c7-484e-9aad-cdb2da0aab60 req-ff0d251a-afcb-4da7-988e-b1874baee4a5 tempest-TestInstancesWithCinderVolumes-72868576 None] attachment_update completed successfully. Jul 07 22:43:30 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=44,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:43:30 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=42,cinder:SELECT=38,cinder:DELETE=4,cinder:INSERT=15 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:43:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:43:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:43:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:43:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-8185015f-d8d6-4e91-921a-1c94551a130c req-66a5d8de-4be0-402d-8d2b-aafb5e6fd4d1 tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:43:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-8185015f-d8d6-4e91-921a-1c94551a130c req-66a5d8de-4be0-402d-8d2b-aafb5e6fd4d1 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:43:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[149b3738-2787-4599-9300-218502f778dd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:43:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-8185015f-d8d6-4e91-921a-1c94551a130c req-66a5d8de-4be0-402d-8d2b-aafb5e6fd4d1 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:43:58 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c Jul 07 22:43:58 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:43:59 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 07 22:43:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-8185015f-d8d6-4e91-921a-1c94551a130c req-66a5d8de-4be0-402d-8d2b-aafb5e6fd4d1 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c" returned: 0 in 0.940s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:43:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-8185015f-d8d6-4e91-921a-1c94551a130c req-66a5d8de-4be0-402d-8d2b-aafb5e6fd4d1 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.963s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:43:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-8185015f-d8d6-4e91-921a-1c94551a130c req-66a5d8de-4be0-402d-8d2b-aafb5e6fd4d1 tempest-TestInstancesWithCinderVolumes-72868576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12223d18-60ef-4372-9530-c503fe4dd0eb', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:43:59 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-8185015f-d8d6-4e91-921a-1c94551a130c req-66a5d8de-4be0-402d-8d2b-aafb5e6fd4d1 tempest-TestInstancesWithCinderVolumes-72868576 None] attachment_update completed successfully. Jul 07 22:44:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-6fdb9cd1-a2b6-485b-85df-599eb65ce9b8 req-664ba4fb-bdaf-4b1d-a9a0-7d3d1e7ac739 tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-6fdb9cd1-a2b6-485b-85df-599eb65ce9b8 req-664ba4fb-bdaf-4b1d-a9a0-7d3d1e7ac739 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a2cb2-9402-4870-8e6a-e7e87031bb57]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-6fdb9cd1-a2b6-485b-85df-599eb65ce9b8 req-664ba4fb-bdaf-4b1d-a9a0-7d3d1e7ac739 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:08 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 Jul 07 22:44:08 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:08 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-6fdb9cd1-a2b6-485b-85df-599eb65ce9b8 req-664ba4fb-bdaf-4b1d-a9a0-7d3d1e7ac739 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1" returned: 0 in 0.782s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-6fdb9cd1-a2b6-485b-85df-599eb65ce9b8 req-664ba4fb-bdaf-4b1d-a9a0-7d3d1e7ac739 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-6fdb9cd1-a2b6-485b-85df-599eb65ce9b8 req-664ba4fb-bdaf-4b1d-a9a0-7d3d1e7ac739 tempest-TestInstancesWithCinderVolumes-72868576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3abc307c-3af2-45e9-a1bf-a11291f249ff', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:44:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-6fdb9cd1-a2b6-485b-85df-599eb65ce9b8 req-664ba4fb-bdaf-4b1d-a9a0-7d3d1e7ac739 tempest-TestInstancesWithCinderVolumes-72868576 None] attachment_update completed successfully. Jul 07 22:44:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-917c7290-d747-4db6-9fef-e7d930f89216 req-da8b368e-d77f-4ded-addd-076333b94d85 tempest-TestInstancesWithCinderVolumes-72868576 None] Terminate volume connection completed successfully. Jul 07 22:44:17 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-917c7290-d747-4db6-9fef-e7d930f89216 req-da8b368e-d77f-4ded-addd-076333b94d85 tempest-TestInstancesWithCinderVolumes-72868576 None] Deleting attachment 12223d18-60ef-4372-9530-c503fe4dd0eb. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:44:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "cinder-5980cd05-d0a8-478b-bc34-62b22d4f1c7c-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-5980cd05-d0a8-478b-bc34-62b22d4f1c7c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "cinder-quobyte-5980cd05-d0a8-478b-bc34-62b22d4f1c7c" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-quobyte-5980cd05-d0a8-478b-bc34-62b22d4f1c7c" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:20 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[410eb81b-1bdf-4816-93f4-c87da3e371cd]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:20 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c Jul 07 22:44:20 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:21 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c" returned: 0 in 0.977s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:21 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c Jul 07 22:44:21 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:21 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-5980cd05-d0a8-478b-bc34-62b22d4f1c7c" returned: 0 in 0.733s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-quobyte-5980cd05-d0a8-478b-bc34-62b22d4f1c7c" released by "delete_volume" :: held 1.754s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:21 devstack cinder-volume[87612]: WARNING cinder.quota [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082406975-1434389054 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082406975-1434389054, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:21 devstack cinder-volume[87612]: WARNING cinder.quota [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082406975-1434389054 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082406975-1434389054, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Created reservations ['41ad11d7-4915-4e0b-a2fc-5f51d569011c', '3da511ca-5c2e-4954-b363-4751bc6ad2dc', 'bee50da1-8fcd-44bc-bf70-5e6cce9f64f6', '0e750916-92c7-4920-ad1c-4b5b0f377818'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:21 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:44:21 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:22 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.782s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:22 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Deleted volume successfully. Jul 07 22:44:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-30a13698-8a57-4e23-a7a6-690875e804dc tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-5980cd05-d0a8-478b-bc34-62b22d4f1c7c-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-d5d7627c-8b7f-487c-831d-d0a6fd669ed8 req-c2993d31-0306-423c-83eb-1be0b2c9b36d tempest-TestInstancesWithCinderVolumes-72868576 None] Terminate volume connection completed successfully. Jul 07 22:44:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-d5d7627c-8b7f-487c-831d-d0a6fd669ed8 req-c2993d31-0306-423c-83eb-1be0b2c9b36d tempest-TestInstancesWithCinderVolumes-72868576 None] Deleting attachment 3abc307c-3af2-45e9-a1bf-a11291f249ff. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:44:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "cinder-25261e73-16cf-4d44-a26e-d8d9e09fb7b1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-25261e73-16cf-4d44-a26e-d8d9e09fb7b1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "cinder-quobyte-25261e73-16cf-4d44-a26e-d8d9e09fb7b1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-quobyte-25261e73-16cf-4d44-a26e-d8d9e09fb7b1" acquired by "delete_volume" :: waited 0.014s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:26 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[515b7dd7-f898-41ca-8c1f-8c825b6eb426]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:26 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 Jul 07 22:44:26 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:27 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1" returned: 0 in 0.942s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:27 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1 Jul 07 22:44:27 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:28 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-25261e73-16cf-4d44-a26e-d8d9e09fb7b1" returned: 0 in 0.740s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-quobyte-25261e73-16cf-4d44-a26e-d8d9e09fb7b1" released by "delete_volume" :: held 1.736s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:28 devstack cinder-volume[87612]: WARNING cinder.quota [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-141272216-141694238 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-141272216-141694238, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:28 devstack cinder-volume[87612]: WARNING cinder.quota [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-141272216-141694238 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-141272216-141694238, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Created reservations ['55a98468-d4b0-401c-bf5c-8b2ec305b188', '571427c4-c6b4-422e-b16a-75356ba60cae', '5ad46ee3-e719-42ab-97be-0c6d78673283', '994fb1f7-c345-484a-a5c1-4e6ea27f632d'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:28 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:44:28 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:29 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.883s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:29 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Deleted volume successfully. Jul 07 22:44:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-bd2debdc-6069-4570-96f1-f619b53458f6 tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-25261e73-16cf-4d44-a26e-d8d9e09fb7b1-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-f09dfe67-696f-4597-a5ad-5328d55d1603 req-95d291e2-4914-4951-9e92-dda525ce6295 tempest-TestInstancesWithCinderVolumes-72868576 None] Terminate volume connection completed successfully. Jul 07 22:44:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-f09dfe67-696f-4597-a5ad-5328d55d1603 req-95d291e2-4914-4951-9e92-dda525ce6295 tempest-TestInstancesWithCinderVolumes-72868576 None] Deleting attachment bc2a2d32-0d87-4b33-a986-f14a6ff0bf99. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:44:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "cinder-59139a0e-ff24-4105-a152-3b65f6813a17-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-59139a0e-ff24-4105-a152-3b65f6813a17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "cinder-quobyte-59139a0e-ff24-4105-a152-3b65f6813a17" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:44:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-quobyte-59139a0e-ff24-4105-a152-3b65f6813a17" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:44:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[17838222-d853-435f-a2bd-f49bd8d3373a]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:44:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:37 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:44:37 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:37 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 0 in 0.826s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:37 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:44:37 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:38 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 1 in 0.844s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:44:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:38 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17 Jul 07 22:44:38 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:39 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-59139a0e-ff24-4105-a152-3b65f6813a17" returned: 0 in 0.750s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-quobyte-59139a0e-ff24-4105-a152-3b65f6813a17" released by "delete_volume" :: held 2.485s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:39 devstack cinder-volume[87612]: WARNING cinder.quota [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844291801-1298317350 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844291801-1298317350, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:39 devstack cinder-volume[87612]: WARNING cinder.quota [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844291801-1298317350 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844291801-1298317350, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Created reservations ['14ef0e00-f149-402a-bb85-ad994146084f', '17f18e67-0a3d-4241-834f-f3496b7fd0f2', '417afb32-6c2b-4077-bffb-d9de7773703c', '3829c06b-e7fc-433c-a2f4-2be1d609f701'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:39 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:44:39 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:40 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.808s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:40 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Deleted volume successfully. Jul 07 22:44:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1597590-c610-4bd4-85f1-75a422d933ff tempest-TestInstancesWithCinderVolumes-72868576 None] Lock "cinder-59139a0e-ff24-4105-a152-3b65f6813a17-delete_volume" released by "delete_volume" :: held 3.534s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:44:49 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=31,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:44:50 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:44:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:44:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:44:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:44:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:44:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:44:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:44:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:44:55 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:44:55 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:44:56 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 07 22:44:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.762s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:44:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:44:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:44:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:44:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Flow 'volume_create_manager' (369f0ac2-27cf-4d95-a923-fbf70d3cbfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999202ae-e3bb-4da8-9466-87e9f5acdf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999202ae-e3bb-4da8-9466-87e9f5acdf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-554661269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19be433-6f01-4159-aaf7-edad791fb0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed38bf8ea84d4905a1fc51f1621c84c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:55Z,use_quota=True,user_id='4eb846da9f3c462fa5e01289192829bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fe59f7-3b2a-40cd-84ab-3c97de687456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fe59f7-3b2a-40cd-84ab-3c97de687456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241933e5-c4ce-40b7-8e9d-7cbbd959d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241933e5-c4ce-40b7-8e9d-7cbbd959d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19be433-6f01-4159-aaf7-edad791fb0bf', 'volume_name': 'volume-d19be433-6f01-4159-aaf7-edad791fb0bf', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133ff95e-6bed-4ff3-8df8-e68e860a16d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133ff95e-6bed-4ff3-8df8-e68e860a16d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cd0938-9cae-4c05-bf28-7f4a3d071619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:54 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Volume d19be433-6f01-4159-aaf7-edad791fb0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19be433-6f01-4159-aaf7-edad791fb0bf', 'volume_size': 1} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-554661269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19be433-6f01-4159-aaf7-edad791fb0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed38bf8ea84d4905a1fc51f1621c84c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:55Z,use_quota=True,user_id='4eb846da9f3c462fa5e01289192829bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Creating volume d19be433-6f01-4159-aaf7-edad791fb0bf {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:45:54 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:45:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:55 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf 1073741824 Jul 07 22:45:55 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:55 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:45:55 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:55 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf 1073741824" returned: 0 in 0.880s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:45:55 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf Jul 07 22:45:55 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:45:56 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.732s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:45:56 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf" returned: 0 in 0.809s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cd0938-9cae-4c05-bf28-7f4a3d071619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19be433-6f01-4159-aaf7-edad791fb0bf', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2672f6-38a1-4fd4-8613-f54df898eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:45:56 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Volume volume-d19be433-6f01-4159-aaf7-edad791fb0bf (d19be433-6f01-4159-aaf7-edad791fb0bf): created successfully Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2672f6-38a1-4fd4-8613-f54df898eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:45:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Flow 'volume_create_manager' (369f0ac2-27cf-4d95-a923-fbf70d3cbfee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:45:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-db878c67-4c38-4fa7-ae3b-07b16b31fe30 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Created volume successfully. Jul 07 22:46:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-3c38568d-6027-4a96-ab63-7851c4ab1b2d req-cb537c0d-f0d9-4840-9a01-84b7a80d57c4 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-3c38568d-6027-4a96-ab63-7851c4ab1b2d req-cb537c0d-f0d9-4840-9a01-84b7a80d57c4 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bda778-115d-434e-a87c-a426519d967c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-3c38568d-6027-4a96-ab63-7851c4ab1b2d req-cb537c0d-f0d9-4840-9a01-84b7a80d57c4 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:00 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf Jul 07 22:46:00 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:01 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-3c38568d-6027-4a96-ab63-7851c4ab1b2d req-cb537c0d-f0d9-4840-9a01-84b7a80d57c4 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf" returned: 0 in 0.868s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-3c38568d-6027-4a96-ab63-7851c4ab1b2d req-cb537c0d-f0d9-4840-9a01-84b7a80d57c4 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.889s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-3c38568d-6027-4a96-ab63-7851c4ab1b2d req-cb537c0d-f0d9-4840-9a01-84b7a80d57c4 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-d19be433-6f01-4159-aaf7-edad791fb0bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3da72c2a-1669-4b36-9757-b6a21da3246b', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:46:01 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-3c38568d-6027-4a96-ab63-7851c4ab1b2d req-cb537c0d-f0d9-4840-9a01-84b7a80d57c4 tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] attachment_update completed successfully. Jul 07 22:46:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-2ea6609f-7904-4f18-801b-17619842993d req-6eca0e7a-da34-4f02-80a3-7b83d7a7745e tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Terminate volume connection completed successfully. Jul 07 22:46:08 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-2ea6609f-7904-4f18-801b-17619842993d req-6eca0e7a-da34-4f02-80a3-7b83d7a7745e tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Deleting attachment 3da72c2a-1669-4b36-9757-b6a21da3246b. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:46:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Acquiring lock "cinder-d19be433-6f01-4159-aaf7-edad791fb0bf-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "cinder-d19be433-6f01-4159-aaf7-edad791fb0bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Acquiring lock "cinder-quobyte-d19be433-6f01-4159-aaf7-edad791fb0bf" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:46:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "cinder-quobyte-d19be433-6f01-4159-aaf7-edad791fb0bf" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:46:10 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[56affdfe-c27f-46ad-a756-d724a355114e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:10 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf Jul 07 22:46:10 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:11 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf" returned: 0 in 0.852s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:11 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf Jul 07 22:46:11 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:12 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d19be433-6f01-4159-aaf7-edad791fb0bf" returned: 0 in 0.746s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "cinder-quobyte-d19be433-6f01-4159-aaf7-edad791fb0bf" released by "delete_volume" :: held 1.641s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Created reservations ['24443e57-b00f-4a64-85a8-892e620a78cc', '0dc92551-6dcc-4f83-9626-6000b1035fa1', '217cc10e-f981-424f-9778-f6bba837b6f9', '037e1450-4ed0-429b-8737-ac80221a9b71'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:12 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:46:12 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:12 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.702s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:13 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Deleted volume successfully. Jul 07 22:46:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-112ff28b-27ed-43eb-9824-5e50cca1414c tempest-TestServerVolumeAttachScenarioOldVersion-771263710 None] Lock "cinder-d19be433-6f01-4159-aaf7-edad791fb0bf-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:46:22 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=13,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:46:23 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:46:47 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:46:47 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:46:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:46:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:46:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:46:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:46:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:46:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:46:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:55 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:46:55 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:46:56 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 07 22:46:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.712s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:46:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:46:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:46:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:46:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Flow 'volume_create_manager' (9dde2d82-4725-432b-87db-89582cb8586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fb1cd6-d8cf-45d0-a2cd-44d80453e6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fb1cd6-d8cf-45d0-a2cd-44d80453e6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1722191971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdabb93-ea12-403d-b5bb-6fabdefc4d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183bbbc0952745eba78d8b60eeb07866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:59Z,use_quota=True,user_id='3b1e27b847d24ceabe3aac06f84a0e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110e546b-1f68-4386-bf12-099b67a632a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110e546b-1f68-4386-bf12-099b67a632a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb7b868-b56c-4ec3-8a19-5fae6e43cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb7b868-b56c-4ec3-8a19-5fae6e43cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffdabb93-ea12-403d-b5bb-6fabdefc4d48', 'volume_name': 'volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22db68d6-f822-4eed-81ca-d35c0cb906a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22db68d6-f822-4eed-81ca-d35c0cb906a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576f6b4f-e463-40db-83f6-80b220513a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:46:58 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Volume ffdabb93-ea12-403d-b5bb-6fabdefc4d48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:46:58 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Trying to clone ffdabb93-ea12-403d-b5bb-6fabdefc4d48 from image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:46:59 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:46:59 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:46:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[03484d23-58da-4c3d-9528-fc36f5b1eb1d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:46:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:46:59 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD Jul 07 22:46:59 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:00 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:00 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Temporary image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 is fetched for user 3b1e27b847d24ceabe3aac06f84a0e2b. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:47:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2042c362-f017-4eb5-b4aa-3830621daf30]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:00 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD Jul 07 22:47:00 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:01 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1722191971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdabb93-ea12-403d-b5bb-6fabdefc4d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183bbbc0952745eba78d8b60eeb07866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:59Z,use_quota=True,user_id='3b1e27b847d24ceabe3aac06f84a0e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Creating volume ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:47:01 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:47:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:01 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 1073741824 Jul 07 22:47:01 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:02 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 1073741824" returned: 0 in 0.927s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:02 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:47:02 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:02 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 0 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:02 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:47:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:02 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Attempting download of 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}])) to volume ffdabb93-ea12-403d-b5bb-6fabdefc4d48. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:47:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd2a619-3b46-4930-bb81-1c52bbc08a5a]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_h5dimo_r {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:03 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_h5dimo_r Jul 07 22:47:03 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:03 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_h5dimo_r" returned: 0 in 0.821s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_h5dimo_r {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:03 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_h5dimo_r Jul 07 22:47:03 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:04 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_h5dimo_r" returned: 1 in 0.725s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_h5dimo_r' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:47:04 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0d937a-589c-4793-aeb9-abd26324dbf8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:04 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD Jul 07 22:47:04 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:05 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:05 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 was qcow2, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:47:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:05 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:47:05 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:07 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 0 in 1.995s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:07 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394_f1x7foaqdevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:47:07 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Converted 112.00 MB image at 56.09 MB/s Jul 07 22:47:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:07 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 1G Jul 07 22:47:07 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:07 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 1G" returned: 0 in 0.739s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[639b3542-acc6-4f61-a416-c91bebe9346a]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:08 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:47:08 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:08 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:08 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:47:08 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:09 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 1 in 0.770s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Downloaded image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}])) to volume ffdabb93-ea12-403d-b5bb-6fabdefc4d48 successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Temporary image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 for user 3b1e27b847d24ceabe3aac06f84a0e2b is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Marking volume ffdabb93-ea12-403d-b5bb-6fabdefc4d48 as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Copying metadata from image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 to ffdabb93-ea12-403d-b5bb-6fabdefc4d48. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Creating volume glance metadata for volume ffdabb93-ea12-403d-b5bb-6fabdefc4d48 backed by image 23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576f6b4f-e463-40db-83f6-80b220513a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48', 'volume_size': 1, 'image_id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987ef9cc8d0541838901c2517686f4ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394', 'created_at': datetime.datetime(2026, 7, 7, 20, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e3a5fa-ffed-4ea6-b3f7-1a16b3dcb394/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28c6e7f-e669-4dba-9896-8741569501f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:47:09 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Volume volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 (ffdabb93-ea12-403d-b5bb-6fabdefc4d48): created successfully Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28c6e7f-e669-4dba-9896-8741569501f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:47:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Flow 'volume_create_manager' (9dde2d82-4725-432b-87db-89582cb8586c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:47:09 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e8a87ead-f76d-484d-bafa-d244cdfb038b tempest-TestShelveInstance-1827903239 None] Created volume successfully. Jul 07 22:47:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1abf409-7cc5-4009-a9cb-4ed5f2fcf64a]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:47:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:17 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:47:17 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:18 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 0 in 0.849s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:18 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:47:18 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:19 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 1 in 0.864s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:47:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.757s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:19 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68dd3d05-b6c3-47c5-b35e-2129b7c6f221', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:47:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-b33e1d3f-b9d2-452b-9f82-0a69efd9dd65 req-a4e5ccdd-9d7e-4b11-b1f2-ff26d6a9b046 tempest-TestShelveInstance-1827903239 None] attachment_update completed successfully. Jul 07 22:47:29 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=7,cinder:SELECT=12,cinder:INSERT=7 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:47:29 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=18,cinder:UPDATE=5,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:47:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:47:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:47:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:47:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:47:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:47:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:47:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:47:55 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:47:55 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:47:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-385ee1e5-02cb-4c4c-b555-28c6da1c4ffc req-50c8ae52-210a-4cb5-8d89-97ecc9345554 tempest-TestShelveInstance-1827903239 None] Terminate volume connection completed successfully. Jul 07 22:47:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-385ee1e5-02cb-4c4c-b555-28c6da1c4ffc req-50c8ae52-210a-4cb5-8d89-97ecc9345554 tempest-TestShelveInstance-1827903239 None] Deleting attachment 68dd3d05-b6c3-47c5-b35e-2129b7c6f221. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:47:56 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 07 22:47:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.681s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:47:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:47:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:47:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:47:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:48:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3e66d8-3b6e-4a29-a17f-d34267d53093]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:02 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:48:02 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:02 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 0 in 0.796s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:02 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:48:02 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:03 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 1 in 0.769s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.618s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc', 'name': 'volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36fd2281-e3df-4609-9cbf-a337ee518fc8', 'enforce_multipath': True} {{(pid=87612) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 22:48:03 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-c0e7f59f-760b-43c5-88e9-36eae481ed8e req-2edd3f6c-4504-44f7-8734-5d364a7f66ea tempest-TestShelveInstance-1827903239 None] attachment_update completed successfully. Jul 07 22:48:13 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:48:13 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:48:47 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:48:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:48:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:48:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:48:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:48:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:48:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:48:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:55 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:48:55 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:56 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.788s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:48:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:48:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:48:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:48:57 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-a0a586e3-bbd0-448a-96d6-a76500971b73 tempest-TestShelveInstance-1827903239 None] Terminate volume connection completed successfully. Jul 07 22:48:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-a0a586e3-bbd0-448a-96d6-a76500971b73 tempest-TestShelveInstance-1827903239 None] Deleting attachment 36fd2281-e3df-4609-9cbf-a337ee518fc8. {{(pid=87612) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 22:48:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Acquiring lock "cinder-ffdabb93-ea12-403d-b5bb-6fabdefc4d48-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Lock "cinder-ffdabb93-ea12-403d-b5bb-6fabdefc4d48-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Acquiring lock "cinder-quobyte-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:48:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Lock "cinder-quobyte-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:48:57 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12b37a8-b3b1-4611-afb7-b627a564af1c]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:48:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:58 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:48:58 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:58 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 0 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:58 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:48:58 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:48:59 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 07 22:48:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 1 in 0.752s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:48:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:48:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:48:59 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48 Jul 07 22:48:59 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:00 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" returned: 0 in 0.612s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Lock "cinder-quobyte-ffdabb93-ea12-403d-b5bb-6fabdefc4d48" released by "delete_volume" :: held 2.202s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG cinder.quota [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Created reservations ['8962bc72-e949-46ed-9fec-e39f56bb3659', '2b4c6a0e-9773-429c-8bf1-423d109fb290', '169d5013-39df-4c40-aaf2-4fbf0d59908f', 'c24a64d3-8e1d-46c9-99db-dee74d0e708e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:00 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:49:00 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:00 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.714s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG cinder.manager [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Deleted volume successfully. Jul 07 22:49:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [req-19d8fc05-9fa1-4a4d-b745-ae130cd1dfe8 req-9d2acbe6-ec18-41e8-b2ab-d9567bd3a80d tempest-TestShelveInstance-1827903239 None] Lock "cinder-ffdabb93-ea12-403d-b5bb-6fabdefc4d48-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:10 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:49:10 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (494c701d-6e91-44d3-8aa1-c09cb1ac3662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e095ed-a984-4d2e-82b8-ffcec437cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e095ed-a984-4d2e-82b8-ffcec437cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354600795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d92bff2-21c8-4061-a546-6e11a775e3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:13Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5ecccf-b2c3-40e8-b9ae-3a70a8b96de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5ecccf-b2c3-40e8-b9ae-3a70a8b96de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bd65d0-a7c6-49bd-b306-c374821ad2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bd65d0-a7c6-49bd-b306-c374821ad2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d92bff2-21c8-4061-a546-6e11a775e3b3', 'volume_name': 'volume-0d92bff2-21c8-4061-a546-6e11a775e3b3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa94420-ab19-4e2e-9fe5-5e40f5082523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa94420-ab19-4e2e-9fe5-5e40f5082523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6811918a-a5bb-4d64-924b-d1119c0fbd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:13 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume 0d92bff2-21c8-4061-a546-6e11a775e3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d92bff2-21c8-4061-a546-6e11a775e3b3', 'volume_size': 1} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354600795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d92bff2-21c8-4061-a546-6e11a775e3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:13Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Creating volume 0d92bff2-21c8-4061-a546-6e11a775e3b3 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:13 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:49:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:13 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 1073741824 Jul 07 22:49:13 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:14 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 1073741824" returned: 0 in 0.808s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:14 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 Jul 07 22:49:14 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:14 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3" returned: 0 in 0.669s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6811918a-a5bb-4d64-924b-d1119c0fbd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d92bff2-21c8-4061-a546-6e11a775e3b3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3cbbb2-86f2-4b24-8396-d0596c2c7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:14 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 (0d92bff2-21c8-4061-a546-6e11a775e3b3): created successfully Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3cbbb2-86f2-4b24-8396-d0596c2c7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (494c701d-6e91-44d3-8aa1-c09cb1ac3662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2be81912-8838-4e4e-ad73-ee635445abb6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created volume successfully. Jul 07 22:49:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Creating offline snapshot f983f826-614d-4c14-a10f-95411afbeeee of volume 0d92bff2-21c8-4061-a546-6e11a775e3b3 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:49:15 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bcf153-90e0-4a13-8d6e-b7053d51a6a9]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:15 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 Jul 07 22:49:15 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:16 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3" returned: 0 in 0.828s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:16 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee 1G Jul 07 22:49:16 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:17 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee 1G" returned: 0 in 0.854s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:17 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee Jul 07 22:49:17 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:17 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee" returned: 0 in 0.749s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:17 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee is being set with open permissions: ugo+rw Jul 07 22:49:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:17 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee Jul 07 22:49:17 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:18 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee" returned: 0 in 0.683s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:18 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.info Jul 07 22:49:18 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:19 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.info" returned: 0 in 0.668s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:19 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.info is being set with open permissions: ugo+rw Jul 07 22:49:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:19 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.info Jul 07 22:49:19 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:19 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.info" returned: 0 in 0.631s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.504s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c4861183-0688-4718-9fb5-a63af29a64b3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Create snapshot completed successfully Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (4b95b90e-d997-4fea-9dfd-a7a9d1692770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e828bc3-0235-45c2-840f-3c2556083855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e828bc3-0235-45c2-840f-3c2556083855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773511074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b9d1e0-0a03-4d11-a375-5d14723e82db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:21Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b474cb-c937-474e-a0ee-f1628ff7abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b474cb-c937-474e-a0ee-f1628ff7abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984a84a8-04a2-4f80-b410-bdf0edabd2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984a84a8-04a2-4f80-b410-bdf0edabd2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b9d1e0-0a03-4d11-a375-5d14723e82db', 'volume_name': 'volume-14b9d1e0-0a03-4d11-a375-5d14723e82db', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6991da-7462-4638-8d1e-b251a27401d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6991da-7462-4638-8d1e-b251a27401d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b3c924-85f6-43d1-af15-946dec58005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume 14b9d1e0-0a03-4d11-a375-5d14723e82db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b9d1e0-0a03-4d11-a375-5d14723e82db', 'volume_size': 1} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773511074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b9d1e0-0a03-4d11-a375-5d14723e82db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:21Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Creating volume 14b9d1e0-0a03-4d11-a375-5d14723e82db {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:21 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:21 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db 1073741824 Jul 07 22:49:21 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (730f495f-4857-4afc-b3f4-b6e72371c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81c6e1f-f4f2-4e14-b974-1abc9feea14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81c6e1f-f4f2-4e14-b974-1abc9feea14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-991984613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2671ed2f-d2af-4495-8141-713ac186d041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:22Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03811a23-95bd-4627-b52f-c3d8b629173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03811a23-95bd-4627-b52f-c3d8b629173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877cd9fb-5142-45d5-a453-2732865f90d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877cd9fb-5142-45d5-a453-2732865f90d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2671ed2f-d2af-4495-8141-713ac186d041', 'volume_name': 'volume-2671ed2f-d2af-4495-8141-713ac186d041', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0285236b-a0e4-4eff-a3d8-4e46e409f940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0285236b-a0e4-4eff-a3d8-4e46e409f940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f4febf-be44-49ba-9a59-683653e98aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:21 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume 2671ed2f-d2af-4495-8141-713ac186d041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2671ed2f-d2af-4495-8141-713ac186d041', 'volume_size': 1} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:21 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (3f1073f1-9d0f-486f-a1f4-62b690434d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530b4156-09a9-4d16-9a34-24e1ecac48bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530b4156-09a9-4d16-9a34-24e1ecac48bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777766805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6498cebd-bec5-44e7-ba21-3f239e385cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:22Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ae9c42-919e-47d4-8a4b-fbfa4a331b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ae9c42-919e-47d4-8a4b-fbfa4a331b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d63ac1-5867-43bc-ab1e-8fe81df1edfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d63ac1-5867-43bc-ab1e-8fe81df1edfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6498cebd-bec5-44e7-ba21-3f239e385cce', 'volume_name': 'volume-6498cebd-bec5-44e7-ba21-3f239e385cce', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803276e1-b6b0-451c-a654-5f7f1eb59058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803276e1-b6b0-451c-a654-5f7f1eb59058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc91298a-b68a-4503-9376-f7cd1ddff4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume 6498cebd-bec5-44e7-ba21-3f239e385cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6498cebd-bec5-44e7-ba21-3f239e385cce', 'volume_size': 1} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:22 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db 1073741824" returned: 0 in 1.135s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (bdacb3ce-b8c9-455e-8896-2ebb9dfab95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edfd7c9-124f-4990-8819-b79a2c82384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edfd7c9-124f-4990-8819-b79a2c82384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1870734927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcca266-6fa3-419f-aceb-ca78b1de2706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:22Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658c40bc-95a6-4d66-a110-7a7cb5429c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658c40bc-95a6-4d66-a110-7a7cb5429c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec2381a-779c-4ed6-80a5-b056f10c492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec2381a-779c-4ed6-80a5-b056f10c492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcca266-6fa3-419f-aceb-ca78b1de2706', 'volume_name': 'volume-fdcca266-6fa3-419f-aceb-ca78b1de2706', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e6d09c-8045-416b-9bd2-45cce316d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e6d09c-8045-416b-9bd2-45cce316d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad6f0ab-2a46-4089-86ec-1315e380a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume fdcca266-6fa3-419f-aceb-ca78b1de2706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcca266-6fa3-419f-aceb-ca78b1de2706', 'volume_size': 1} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:22 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db Jul 07 22:49:22 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (94040858-6007-4f6f-a507-a5698bf6044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f35a14c-e9ef-4787-ac26-afb83add716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f35a14c-e9ef-4787-ac26-afb83add716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-474303909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3914c1d7-25ca-459f-8851-013d804219c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:23Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338486a0-e984-40be-9e8b-b5b1d7530c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338486a0-e984-40be-9e8b-b5b1d7530c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afa003b-ba5a-4f16-9342-cdd36bc915ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afa003b-ba5a-4f16-9342-cdd36bc915ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3914c1d7-25ca-459f-8851-013d804219c2', 'volume_name': 'volume-3914c1d7-25ca-459f-8851-013d804219c2', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30cd54e-85cd-48cf-ba3e-eb23e40f358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30cd54e-85cd-48cf-ba3e-eb23e40f358e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889508db-4dff-457c-a5a8-f40c03c82dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:22 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume 3914c1d7-25ca-459f-8851-013d804219c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3914c1d7-25ca-459f-8851-013d804219c2', 'volume_size': 1} Jul 07 22:49:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:23 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db" returned: 0 in 0.706s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-991984613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2671ed2f-d2af-4495-8141-713ac186d041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:22Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Creating volume 2671ed2f-d2af-4495-8141-713ac186d041 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:23 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b3c924-85f6-43d1-af15-946dec58005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b9d1e0-0a03-4d11-a375-5d14723e82db', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:23 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 1073741824 Jul 07 22:49:23 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6224d0c-c8b7-4a9b-9e42-f39b06c6105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:23 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume volume-14b9d1e0-0a03-4d11-a375-5d14723e82db (14b9d1e0-0a03-4d11-a375-5d14723e82db): created successfully Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6224d0c-c8b7-4a9b-9e42-f39b06c6105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (4b95b90e-d997-4fea-9dfd-a7a9d1692770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cc5897b4-d14b-4132-97d8-69c41ce6590d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created volume successfully. Jul 07 22:49:24 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 1073741824" returned: 0 in 0.855s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:24 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 Jul 07 22:49:24 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:24 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041" returned: 0 in 0.690s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.706s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777766805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6498cebd-bec5-44e7-ba21-3f239e385cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:22Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Creating volume 6498cebd-bec5-44e7-ba21-3f239e385cce {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:24 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:24 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce 1073741824 Jul 07 22:49:24 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f4febf-be44-49ba-9a59-683653e98aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2671ed2f-d2af-4495-8141-713ac186d041', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48ab097-8607-454c-a234-64bbbeccc4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:24 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume volume-2671ed2f-d2af-4495-8141-713ac186d041 (2671ed2f-d2af-4495-8141-713ac186d041): created successfully Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48ab097-8607-454c-a234-64bbbeccc4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (730f495f-4857-4afc-b3f4-b6e72371c023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-bb876448-e4a8-4810-9344-dc81bb0abc4c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created volume successfully. Jul 07 22:49:25 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce 1073741824" returned: 0 in 0.857s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:25 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce Jul 07 22:49:25 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:26 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce" returned: 0 in 0.712s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.932s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1870734927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcca266-6fa3-419f-aceb-ca78b1de2706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:22Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Creating volume fdcca266-6fa3-419f-aceb-ca78b1de2706 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:26 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc91298a-b68a-4503-9376-f7cd1ddff4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6498cebd-bec5-44e7-ba21-3f239e385cce', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:26 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 1073741824 Jul 07 22:49:26 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf65bc1-178a-4c34-8d36-8a0cbada7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:26 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume volume-6498cebd-bec5-44e7-ba21-3f239e385cce (6498cebd-bec5-44e7-ba21-3f239e385cce): created successfully Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf65bc1-178a-4c34-8d36-8a0cbada7df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (3f1073f1-9d0f-486f-a1f4-62b690434d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d110a183-f11b-4418-8788-471276d669fb tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created volume successfully. Jul 07 22:49:27 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 1073741824" returned: 0 in 0.885s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:27 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 Jul 07 22:49:27 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:28 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706" returned: 0 in 0.697s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.125s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-474303909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3914c1d7-25ca-459f-8851-013d804219c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7577f8e8236747f48fd09a29b915990d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:23Z,use_quota=True,user_id='ee1353da8b314e719a531365b208de5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Creating volume 3914c1d7-25ca-459f-8851-013d804219c2 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:28 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad6f0ab-2a46-4089-86ec-1315e380a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcca266-6fa3-419f-aceb-ca78b1de2706', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:28 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 1073741824 Jul 07 22:49:28 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d82a98-d6f2-4c22-b484-ff58fdee6c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 (fdcca266-6fa3-419f-aceb-ca78b1de2706): created successfully Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d82a98-d6f2-4c22-b484-ff58fdee6c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (bdacb3ce-b8c9-455e-8896-2ebb9dfab95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3c3ae13c-7ae0-4506-884a-8e6ded91b329 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created volume successfully. Jul 07 22:49:28 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 1073741824" returned: 0 in 0.929s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:29 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 Jul 07 22:49:29 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:29 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2" returned: 0 in 0.720s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889508db-4dff-457c-a5a8-f40c03c82dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3914c1d7-25ca-459f-8851-013d804219c2', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815c180a-c5fe-4639-badf-6839ab076e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:29 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Volume volume-3914c1d7-25ca-459f-8851-013d804219c2 (3914c1d7-25ca-459f-8851-013d804219c2): created successfully Jul 07 22:49:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815c180a-c5fe-4639-badf-6839ab076e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Flow 'volume_create_manager' (94040858-6007-4f6f-a507-a5698bf6044e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6939bdcc-5b24-4ddc-a457-0bb2d59536f6 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created volume successfully. Jul 07 22:49:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-3914c1d7-25ca-459f-8851-013d804219c2-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-3914c1d7-25ca-459f-8851-013d804219c2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-quobyte-3914c1d7-25ca-459f-8851-013d804219c2" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-3914c1d7-25ca-459f-8851-013d804219c2" acquired by "delete_volume" :: waited 0.014s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[530b1e21-6cef-495b-b1b6-78317098f1be]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:30 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 Jul 07 22:49:30 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:31 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2" returned: 0 in 0.867s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:31 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2 Jul 07 22:49:31 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:32 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3914c1d7-25ca-459f-8851-013d804219c2" returned: 0 in 0.653s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-3914c1d7-25ca-459f-8851-013d804219c2" released by "delete_volume" :: held 1.580s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created reservations ['7ef35f8e-c0e5-460d-b8a0-47d0e10794a9', '836e2aa0-e4d5-426f-8238-89f4e7332405', '8d245431-a60a-402a-afae-199a5077d71f', 'd65ac310-928f-49d2-851a-0ead56da7fce'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:32 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:49:32 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-fdcca266-6fa3-419f-aceb-ca78b1de2706-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-fdcca266-6fa3-419f-aceb-ca78b1de2706-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-quobyte-fdcca266-6fa3-419f-aceb-ca78b1de2706" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-fdcca266-6fa3-419f-aceb-ca78b1de2706" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[93540a14-96ab-44d9-8abd-e8f4ebd347ef]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:33 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 Jul 07 22:49:33 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:33 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.699s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:33 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Deleted volume successfully. Jul 07 22:49:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f8994e08-c651-4ff8-a92a-dbde7209a608 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-3914c1d7-25ca-459f-8851-013d804219c2-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:33 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706" returned: 0 in 0.788s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:33 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706 Jul 07 22:49:33 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:34 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fdcca266-6fa3-419f-aceb-ca78b1de2706" returned: 0 in 0.698s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-fdcca266-6fa3-419f-aceb-ca78b1de2706" released by "delete_volume" :: held 1.534s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created reservations ['41a45f6c-496f-4422-b090-d458a7df5b2d', 'b06d7480-8a18-4e1a-be0c-fc5038807768', '0a01f2a1-e570-4079-a9a3-69eb262cdfe5', 'a33c4854-41a8-4dba-91fc-4234f168abd1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:34 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:49:34 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-6498cebd-bec5-44e7-ba21-3f239e385cce-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-6498cebd-bec5-44e7-ba21-3f239e385cce-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-quobyte-6498cebd-bec5-44e7-ba21-3f239e385cce" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-6498cebd-bec5-44e7-ba21-3f239e385cce" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c2db6a-ae48-4c39-a811-6a43941571c7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:35 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.726s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:35 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Deleted volume successfully. Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-81853946-a81d-4d43-9110-2729548e283c tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-fdcca266-6fa3-419f-aceb-ca78b1de2706-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:35 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce Jul 07 22:49:35 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:35 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce" returned: 0 in 0.748s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:36 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce Jul 07 22:49:36 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:36 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-6498cebd-bec5-44e7-ba21-3f239e385cce" returned: 0 in 0.668s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-6498cebd-bec5-44e7-ba21-3f239e385cce" released by "delete_volume" :: held 1.460s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created reservations ['3d48a381-4537-455b-9de3-ecb7dac4f147', '0dc33c31-ddc5-4b4d-8787-9e20f59dea31', '5555133d-d8cb-4ac5-b783-82b3f9ac8f43', '4c531ba6-7601-482f-9f67-81b8d3e1ae34'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:36 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:49:36 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-2671ed2f-d2af-4495-8141-713ac186d041-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-2671ed2f-d2af-4495-8141-713ac186d041-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-quobyte-2671ed2f-d2af-4495-8141-713ac186d041" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-2671ed2f-d2af-4495-8141-713ac186d041" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4dec7c-ac17-4132-b4a2-7b17768acc48]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:37 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.697s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Deleted volume successfully. Jul 07 22:49:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-46b9d966-be14-4015-b35e-e1a8489bdb1f tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-6498cebd-bec5-44e7-ba21-3f239e385cce-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:37 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 Jul 07 22:49:37 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:38 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041" returned: 0 in 0.830s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:38 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041 Jul 07 22:49:38 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:38 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2671ed2f-d2af-4495-8141-713ac186d041" returned: 0 in 0.649s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-2671ed2f-d2af-4495-8141-713ac186d041" released by "delete_volume" :: held 1.524s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created reservations ['178199ad-9b65-4ee7-9182-3e0756cda2ca', 'db17a899-821b-4143-90a7-115664ee315d', '0bb31e5c-37b1-40b9-b008-0a4dc33be522', '8130c255-8701-479f-ae16-6490fce53ef1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:39 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:49:39 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-14b9d1e0-0a03-4d11-a375-5d14723e82db-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-14b9d1e0-0a03-4d11-a375-5d14723e82db-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-quobyte-14b9d1e0-0a03-4d11-a375-5d14723e82db" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-14b9d1e0-0a03-4d11-a375-5d14723e82db" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[07089e91-a258-429c-b80d-dbdda9e9203e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:39 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.660s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Deleted volume successfully. Jul 07 22:49:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c92583ba-c986-4333-bc4f-7b20c7eb73bd tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-2671ed2f-d2af-4495-8141-713ac186d041-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:39 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db Jul 07 22:49:39 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:40 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db" returned: 0 in 0.820s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:40 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db Jul 07 22:49:40 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:41 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-14b9d1e0-0a03-4d11-a375-5d14723e82db" returned: 0 in 0.664s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-14b9d1e0-0a03-4d11-a375-5d14723e82db" released by "delete_volume" :: held 1.530s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created reservations ['e58602f4-1147-4dfd-ae78-f8866ca80510', '91d63eb6-e9c9-4423-81c5-2f7cd55d2fb9', '85bb7435-6392-4053-8ab5-a8eecb38fd28', 'ea84acf0-2896-477a-ba7e-9652aa98436a'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:41 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:49:41 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-f983f826-614d-4c14-a10f-95411afbeeee-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-f983f826-614d-4c14-a10f-95411afbeeee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-quobyte-0d92bff2-21c8-4061-a546-6e11a775e3b3" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-0d92bff2-21c8-4061-a546-6e11a775e3b3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-quobyte-f983f826-614d-4c14-a10f-95411afbeeee" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-f983f826-614d-4c14-a10f-95411afbeeee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Deleting offline snapshot f983f826-614d-4c14-a10f-95411afbeeee of volume 0d92bff2-21c8-4061-a546-6e11a775e3b3 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] snapshot_file for this snap is: volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6944470-60b2-4907-9609-e72f550b8c80]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:42 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.718s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:42 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:42 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Deleted volume successfully. Jul 07 22:49:42 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee Jul 07 22:49:42 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8b19de54-91e0-4f3c-8136-b21e57e1acf3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-14b9d1e0-0a03-4d11-a375-5d14723e82db-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:42 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee" returned: 0 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d92bff2-21c8-4061-a546-6e11a775e3b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:49:42 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca05c97-318e-49fb-adb7-eb7fcb37a4fe]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:42 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 Jul 07 22:49:42 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:43 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3" returned: 0 in 0.781s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:43 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee Jul 07 22:49:43 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:44 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee" returned: 0 in 0.805s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:44 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee Jul 07 22:49:44 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:45 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3.f983f826-614d-4c14-a10f-95411afbeeee" returned: 0 in 0.656s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-f983f826-614d-4c14-a10f-95411afbeeee" released by "_delete_snapshot" :: held 3.111s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-0d92bff2-21c8-4061-a546-6e11a775e3b3" released by "delete_snapshot" :: held 3.135s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:45 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created reservations ['36a30fd6-e369-4d3f-b7e2-d675aa73b2b8', '569b4ec9-db7d-4e8e-b859-3c9d3ac9f3d0', '81ac3864-c857-468d-b0b7-3a05c73916af', '393fc5c8-64f3-401c-852e-96562e7dd9f1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Delete snapshot completed successfully. Jul 07 22:49:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0e231ee9-b039-4c16-8128-c24787c9d5d3 tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-f983f826-614d-4c14-a10f-95411afbeeee-delete_snapshot" released by "delete_snapshot" :: held 3.275s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-0d92bff2-21c8-4061-a546-6e11a775e3b3-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-0d92bff2-21c8-4061-a546-6e11a775e3b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "cinder-quobyte-0d92bff2-21c8-4061-a546-6e11a775e3b3" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:49:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-0d92bff2-21c8-4061-a546-6e11a775e3b3" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:49:46 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46a04e1-2ec4-4754-b0e9-7374523e89fc]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:46 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 Jul 07 22:49:46 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:47 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3" returned: 0 in 0.818s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:47 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3 Jul 07 22:49:47 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:47 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-0d92bff2-21c8-4061-a546-6e11a775e3b3" returned: 0 in 0.701s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-quobyte-0d92bff2-21c8-4061-a546-6e11a775e3b3" released by "delete_volume" :: held 1.581s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:47 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Created reservations ['0f1dda47-a65b-4e45-9ae2-de95bf27cb68', '46ef7ee7-6018-4830-937b-d469627adcdc', 'd5b00aa1-cb5e-4aad-b69e-3b43a84d587b', '2ed73630-e8b9-4e89-b8b5-6f1a075d07b2'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:48 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:49:48 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:48 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.746s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Deleted volume successfully. Jul 07 22:49:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-28eb27b6-3e8f-40f8-bdc1-eaa1299faa7d tempest-CreateVolumesFromSnapshotTest-1832855503 None] Lock "cinder-0d92bff2-21c8-4061-a546-6e11a775e3b3-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:49:53 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:49:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Flow 'volume_create_manager' (86b00f16-0340-4870-9307-07e419298da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:49:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de8d627-5ee6-40a9-a90b-ae4c07011e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de8d627-5ee6-40a9-a90b-ae4c07011e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfd8cce-18e0-4d97-b5f1-76e66867f63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b817a0b5073543f296669ac30b2e4c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:54Z,use_quota=True,user_id='68cb8f32061242e6aa9bdeac5f1d8c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed7d854-790e-4a30-8ec4-b188b025ea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed7d854-790e-4a30-8ec4-b188b025ea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239eb298-e2d7-4873-9c1a-c9f33b7e41bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:53 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:49:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239eb298-e2d7-4873-9c1a-c9f33b7e41bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbfd8cce-18e0-4d97-b5f1-76e66867f63c', 'volume_name': 'volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c', 'volume_size': 1, 'image_id': '0daedff3-cf5c-40e2-9d21-c531a6f77648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0daedff3-cf5c-40e2-9d21-c531a6f77648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e901b9c9f01b77695115c2e484a01ebd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b817a0b5073543f296669ac30b2e4c23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9f3e2539e0649d77e03c6e9d77213ea96be228304bc858a20ef2356acab13e6c86661c44669e0e9bc11d05b5983d53824e243187220e6b434eee3061279d049', 'id': '0daedff3-cf5c-40e2-9d21-c531a6f77648', 'created_at': datetime.datetime(2026, 7, 7, 20, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 49, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0daedff3-cf5c-40e2-9d21-c531a6f77648/file', 'properties': {}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9a6df8-52a2-4ef0-995b-9bfd193b8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9a6df8-52a2-4ef0-995b-9bfd193b8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:49:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8211352f-f40c-4347-82cd-a01af28ae056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:49:54 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Volume bbfd8cce-18e0-4d97-b5f1-76e66867f63c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c', 'volume_size': 1, 'image_id': '0daedff3-cf5c-40e2-9d21-c531a6f77648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0daedff3-cf5c-40e2-9d21-c531a6f77648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e901b9c9f01b77695115c2e484a01ebd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b817a0b5073543f296669ac30b2e4c23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9f3e2539e0649d77e03c6e9d77213ea96be228304bc858a20ef2356acab13e6c86661c44669e0e9bc11d05b5983d53824e243187220e6b434eee3061279d049', 'id': '0daedff3-cf5c-40e2-9d21-c531a6f77648', 'created_at': datetime.datetime(2026, 7, 7, 20, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 49, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0daedff3-cf5c-40e2-9d21-c531a6f77648/file', 'properties': {}}, 'image_service': } Jul 07 22:49:54 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Trying to clone bbfd8cce-18e0-4d97-b5f1-76e66867f63c from image 0daedff3-cf5c-40e2-9d21-c531a6f77648 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0daedff3-cf5c-40e2-9d21-c531a6f77648', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:49:54 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:49:54 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:49:54 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eb6904-6c1f-40ca-9096-7f77eec46adb]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:54 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD Jul 07 22:49:54 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:55 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:55 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD Jul 07 22:49:55 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:55 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD" returned: 1 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Temporary image 0daedff3-cf5c-40e2-9d21-c531a6f77648 is fetched for user 68cb8f32061242e6aa9bdeac5f1d8c7d. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:55 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:49:55 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd395137-2d0e-40c8-a24d-5b3f77fee3a8]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:55 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD Jul 07 22:49:55 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:56 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.693s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:49:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:49:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:49:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:49:56 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:56 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD Jul 07 22:49:56 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:57 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfd8cce-18e0-4d97-b5f1-76e66867f63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b817a0b5073543f296669ac30b2e4c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:54Z,use_quota=True,user_id='68cb8f32061242e6aa9bdeac5f1d8c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Creating volume bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:49:57 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:49:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:57 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c 1073741824 Jul 07 22:49:57 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:58 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c 1073741824" returned: 0 in 0.869s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:58 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c Jul 07 22:49:58 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:58 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" returned: 0 in 0.650s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:49:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:49:59 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Attempting download of 0daedff3-cf5c-40e2-9d21-c531a6f77648 ((None, [{'url': 'file:///opt/stack/data/glance/images/0daedff3-cf5c-40e2-9d21-c531a6f77648', 'metadata': {}}])) to volume bbfd8cce-18e0-4d97-b5f1-76e66867f63c. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:49:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4260c2d8-5d82-47cb-b45e-fcd8676530af]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:49:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0daedff3-cf5c-40e2-9d21-c531a6f77648_beoedm8v {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:59 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0daedff3-cf5c-40e2-9d21-c531a6f77648_beoedm8v Jul 07 22:49:59 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:49:59 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 07 22:49:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0daedff3-cf5c-40e2-9d21-c531a6f77648_beoedm8v" returned: 0 in 0.741s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:49:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0daedff3-cf5c-40e2-9d21-c531a6f77648_beoedm8v {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:49:59 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0daedff3-cf5c-40e2-9d21-c531a6f77648_beoedm8v Jul 07 22:49:59 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:00 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0daedff3-cf5c-40e2-9d21-c531a6f77648_beoedm8v" returned: 1 in 0.752s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0daedff3-cf5c-40e2-9d21-c531a6f77648_beoedm8v' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9dbf24-a3bb-42b7-93f8-093e4ec889d0]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:00 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD Jul 07 22:50:00 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:01 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:01 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD Jul 07 22:50:01 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:02 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD" returned: 1 in 0.682s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:02 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] 0daedff3-cf5c-40e2-9d21-c531a6f77648 was raw, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:50:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:02 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c Jul 07 22:50:02 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:02 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" returned: 0 in 0.693s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:02 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0daedff3-cf5c-40e2-9d21-c531a6f77648_gsps0vgudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:50:02 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:50:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:02 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c 1G Jul 07 22:50:02 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:03 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c 1G" returned: 0 in 0.698s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:03 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2082bd7f-6065-45c7-9f08-9790c2483e53]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:03 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c Jul 07 22:50:03 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:04 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" returned: 0 in 0.735s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:04 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c Jul 07 22:50:04 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:04 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" returned: 1 in 0.728s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Downloaded image 0daedff3-cf5c-40e2-9d21-c531a6f77648 ((None, [{'url': 'file:///opt/stack/data/glance/images/0daedff3-cf5c-40e2-9d21-c531a6f77648', 'metadata': {}}])) to volume bbfd8cce-18e0-4d97-b5f1-76e66867f63c successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Temporary image 0daedff3-cf5c-40e2-9d21-c531a6f77648 for user 68cb8f32061242e6aa9bdeac5f1d8c7d is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Marking volume bbfd8cce-18e0-4d97-b5f1-76e66867f63c as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Copying metadata from image 0daedff3-cf5c-40e2-9d21-c531a6f77648 to bbfd8cce-18e0-4d97-b5f1-76e66867f63c. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:50:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Creating volume glance metadata for volume bbfd8cce-18e0-4d97-b5f1-76e66867f63c backed by image 0daedff3-cf5c-40e2-9d21-c531a6f77648 with: {'image_id': '0daedff3-cf5c-40e2-9d21-c531a6f77648', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e901b9c9f01b77695115c2e484a01ebd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8211352f-f40c-4347-82cd-a01af28ae056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c', 'volume_size': 1, 'image_id': '0daedff3-cf5c-40e2-9d21-c531a6f77648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0daedff3-cf5c-40e2-9d21-c531a6f77648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e901b9c9f01b77695115c2e484a01ebd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b817a0b5073543f296669ac30b2e4c23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9f3e2539e0649d77e03c6e9d77213ea96be228304bc858a20ef2356acab13e6c86661c44669e0e9bc11d05b5983d53824e243187220e6b434eee3061279d049', 'id': '0daedff3-cf5c-40e2-9d21-c531a6f77648', 'created_at': datetime.datetime(2026, 7, 7, 20, 49, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 49, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0daedff3-cf5c-40e2-9d21-c531a6f77648/file', 'properties': {}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c4e742-f76b-409c-a70d-9acba2e38e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:05 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Volume volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c (bbfd8cce-18e0-4d97-b5f1-76e66867f63c): created successfully Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c4e742-f76b-409c-a70d-9acba2e38e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Flow 'volume_create_manager' (86b00f16-0340-4870-9307-07e419298da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-63f470a1-a015-4fdd-ba6f-044875199874 tempest-VolumeImageDependencyTests-1570948320 None] Created volume successfully. Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Acquiring lock "cinder-bbfd8cce-18e0-4d97-b5f1-76e66867f63c-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Lock "cinder-bbfd8cce-18e0-4d97-b5f1-76e66867f63c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Acquiring lock "cinder-quobyte-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Lock "cinder-quobyte-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" acquired by "delete_volume" :: waited 0.013s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea1df06-0760-4348-92d1-0c981e08434c]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:06 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c Jul 07 22:50:06 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:06 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:06 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c Jul 07 22:50:06 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:07 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" returned: 1 in 0.779s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:07 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c Jul 07 22:50:07 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:08 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" returned: 0 in 0.660s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Lock "cinder-quobyte-bbfd8cce-18e0-4d97-b5f1-76e66867f63c" released by "delete_volume" :: held 2.287s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Created reservations ['fc64b15c-fc22-4c8b-b2da-b01c19fc0d77', '21eda63e-87cc-4fc1-8628-0ac8aa02b38f', 'cdd4917f-6677-455d-8725-36d6f9197f8c', 'fdac50cf-e33d-4989-aa61-dee932deb8a7'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:08 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:08 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:08 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.666s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:08 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Deleted volume successfully. Jul 07 22:50:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-23107e88-2104-44b2-a684-0bd3f23d06fe tempest-VolumeImageDependencyTests-1570948320 None] Lock "cinder-bbfd8cce-18e0-4d97-b5f1-76e66867f63c-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:18 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=64,cinder:UPDATE=92,cinder:INSERT=18,cinder:DELETE=8 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:50:18 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=79,cinder:SELECT=63,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (c94d6cfa-eed7-44c5-a1d2-2558a8845ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36a03d8-9a5c-4434-896a-b5a0364d601a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36a03d8-9a5c-4434-896a-b5a0364d601a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-780689186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3975c415-f3dd-4009-ac38-b4f34221f796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:26Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06705e79-5ae5-415c-bc11-dedd5c9c62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06705e79-5ae5-415c-bc11-dedd5c9c62c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c61e45-5b33-4a8b-985a-b1bac49d0b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c61e45-5b33-4a8b-985a-b1bac49d0b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3975c415-f3dd-4009-ac38-b4f34221f796', 'volume_name': 'volume-3975c415-f3dd-4009-ac38-b4f34221f796', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac01fd5a-8a20-4b7c-9908-8d9a40c3de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac01fd5a-8a20-4b7c-9908-8d9a40c3de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6989f2e2-b8b0-4849-9e0f-d914e6261248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:25 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Volume 3975c415-f3dd-4009-ac38-b4f34221f796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3975c415-f3dd-4009-ac38-b4f34221f796', 'volume_size': 1} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-780689186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3975c415-f3dd-4009-ac38-b4f34221f796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:26Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Creating volume 3975c415-f3dd-4009-ac38-b4f34221f796 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:26 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:26 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 1073741824 Jul 07 22:50:26 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (e6bde30a-b694-4f7d-9568-5839162e08ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a275b8ed-f8b7-4fb3-8bb6-f5224823b0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a275b8ed-f8b7-4fb3-8bb6-f5224823b0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855484504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635b815c-faf1-485d-9436-25c3e62c310e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:26Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7add330f-958c-4167-afc1-b41b37aa1933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7add330f-958c-4167-afc1-b41b37aa1933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169265cd-c4a6-4260-9e3e-1c5562672216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169265cd-c4a6-4260-9e3e-1c5562672216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635b815c-faf1-485d-9436-25c3e62c310e', 'volume_name': 'volume-635b815c-faf1-485d-9436-25c3e62c310e', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a24563-4d30-4bd6-9d73-67a9d0bbb575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a24563-4d30-4bd6-9d73-67a9d0bbb575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b397222c-f438-4106-aa2c-5a5fa7d0581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:26 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Volume 635b815c-faf1-485d-9436-25c3e62c310e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635b815c-faf1-485d-9436-25c3e62c310e', 'volume_size': 1} Jul 07 22:50:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (f4c94b30-ecc9-44ef-a37e-55b3aab2fd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02650d41-fd72-4772-8e70-1c758f1d4d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02650d41-fd72-4772-8e70-1c758f1d4d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356615216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03406036-db47-4763-88d5-1cc95524f5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:27Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1dacb1b-2cd5-4e90-9c78-f5c08cd5046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1dacb1b-2cd5-4e90-9c78-f5c08cd5046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bf0c43-1fa8-4d8f-94f2-770031956323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bf0c43-1fa8-4d8f-94f2-770031956323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03406036-db47-4763-88d5-1cc95524f5da', 'volume_name': 'volume-03406036-db47-4763-88d5-1cc95524f5da', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aace253-3246-47e4-8d34-9fc18fddc7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aace253-3246-47e4-8d34-9fc18fddc7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5965da-1ada-4bcf-8bea-d4f884f4d0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Volume 03406036-db47-4763-88d5-1cc95524f5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03406036-db47-4763-88d5-1cc95524f5da', 'volume_size': 1} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 1073741824" returned: 0 in 1.290s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:27 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 Jul 07 22:50:27 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (471dc0a8-51f8-464a-8d02-304ed76251c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48efbcfc-bfa2-449a-aa2a-4c0b3cb1a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48efbcfc-bfa2-449a-aa2a-4c0b3cb1a738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897368603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052fcb4b-01ed-4d71-9e03-fa22cda011e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:28Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d2c935-f7ee-4d5d-a9d4-ec81570b0399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d2c935-f7ee-4d5d-a9d4-ec81570b0399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5e91a2-0d89-4adc-8dd7-ccdbd33b8d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5e91a2-0d89-4adc-8dd7-ccdbd33b8d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052fcb4b-01ed-4d71-9e03-fa22cda011e7', 'volume_name': 'volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e13c44-b661-4711-8ad5-34e10042e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e13c44-b661-4711-8ad5-34e10042e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1789cb96-4b6d-4dca-baba-8fbe0a34a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:27 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Volume 052fcb4b-01ed-4d71-9e03-fa22cda011e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7', 'volume_size': 1} Jul 07 22:50:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (e452fc0e-cfd3-4afa-9230-226283deeb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10ed6f5-afe3-43e9-bb00-098e85bba02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10ed6f5-afe3-43e9-bb00-098e85bba02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48997461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a37a913-ef38-49ba-8557-fd3c0ec44282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:28Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20513cb8-1b68-4fbb-9dfd-e16a2bb39cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20513cb8-1b68-4fbb-9dfd-e16a2bb39cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:28 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a990de24-9e33-4d2a-9a9f-366aa72fd2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a990de24-9e33-4d2a-9a9f-366aa72fd2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a37a913-ef38-49ba-8557-fd3c0ec44282', 'volume_name': 'volume-1a37a913-ef38-49ba-8557-fd3c0ec44282', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb642cc0-f806-48f3-85d6-adb9e5695ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb642cc0-f806-48f3-85d6-adb9e5695ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e323e542-2837-45cf-b8eb-62cd7ecaa19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Volume 1a37a913-ef38-49ba-8557-fd3c0ec44282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a37a913-ef38-49ba-8557-fd3c0ec44282', 'volume_size': 1} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796" returned: 0 in 1.075s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.586s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855484504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635b815c-faf1-485d-9436-25c3e62c310e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:26Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Creating volume 635b815c-faf1-485d-9436-25c3e62c310e {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:28 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6989f2e2-b8b0-4849-9e0f-d914e6261248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3975c415-f3dd-4009-ac38-b4f34221f796', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:28 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e 1073741824 Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ead2139-88fa-47bf-a5b5-736123e9726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:28 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Volume volume-3975c415-f3dd-4009-ac38-b4f34221f796 (3975c415-f3dd-4009-ac38-b4f34221f796): created successfully Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ead2139-88fa-47bf-a5b5-736123e9726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (c94d6cfa-eed7-44c5-a1d2-2558a8845ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-eba6212a-e065-4dbe-bfe1-1e4f4d431fc3 tempest-CreateVolumesFromImageTest-1105446624 None] Created volume successfully. Jul 07 22:50:29 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e 1073741824" returned: 0 in 1.084s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:29 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e Jul 07 22:50:29 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Flow 'volume_create_manager' (c240d5ca-6318-489a-a770-5ab6c0d034a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:30 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2d7ad7-36e0-4c82-a792-59226322bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e" returned: 0 in 1.178s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] <== create_volume: return (2316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.319s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.448s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356615216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03406036-db47-4763-88d5-1cc95524f5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:27Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Creating volume 03406036-db47-4763-88d5-1cc95524f5da {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:30 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2d7ad7-36e0-4c82-a792-59226322bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7093ad0-b998-43e4-befb-b1a9ff811c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c56b9ad83a49f782397fdb2da2fb5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:31Z,use_quota=True,user_id='7f9c9ca5ef1748c4b745bfd889241960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05609a5d-370e-42c8-8fed-d970c925a027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:30 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da 1073741824 Jul 07 22:50:30 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05609a5d-370e-42c8-8fed-d970c925a027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4eb4b0-f2cd-4948-b56e-0567c5a51fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b397222c-f438-4106-aa2c-5a5fa7d0581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635b815c-faf1-485d-9436-25c3e62c310e', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f881bdf-921c-437c-80f7-a35aa1da0c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Volume volume-635b815c-faf1-485d-9436-25c3e62c310e (635b815c-faf1-485d-9436-25c3e62c310e): created successfully Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f881bdf-921c-437c-80f7-a35aa1da0c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (e6bde30a-b694-4f7d-9568-5839162e08ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c0b4f03e-e91b-4526-8f45-bbe0408fc338 tempest-CreateVolumesFromImageTest-1105446624 None] Created volume successfully. Jul 07 22:50:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4eb4b0-f2cd-4948-b56e-0567c5a51fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7093ad0-b998-43e4-befb-b1a9ff811c07', 'volume_name': 'volume-c7093ad0-b998-43e4-befb-b1a9ff811c07', 'volume_size': 1, 'image_id': '94fc3acf-a7a9-4325-b46b-a925aab59b43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94fc3acf-a7a9-4325-b46b-a925aab59b43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c4fcfd5ec8defec31116b9cbeedec23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50c56b9ad83a49f782397fdb2da2fb5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9dedbf2f6ae2b45606ddf8ca688a334b5456eda99799f6f17142e8d60d4a8cef5f6195213a7c5b8e868d9c30180d3b9959b8005f54c95fbe7abd2c938ac3f104', 'id': '94fc3acf-a7a9-4325-b46b-a925aab59b43', 'created_at': datetime.datetime(2026, 7, 7, 20, 50, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 50, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94fc3acf-a7a9-4325-b46b-a925aab59b43/file', 'properties': {}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc93731-8307-4845-800d-bf38a8519521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc93731-8307-4845-800d-bf38a8519521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0adda2-3ee0-41dd-bc90-9412ab131879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:31 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Volume c7093ad0-b998-43e4-befb-b1a9ff811c07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7093ad0-b998-43e4-befb-b1a9ff811c07', 'volume_size': 1, 'image_id': '94fc3acf-a7a9-4325-b46b-a925aab59b43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94fc3acf-a7a9-4325-b46b-a925aab59b43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c4fcfd5ec8defec31116b9cbeedec23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50c56b9ad83a49f782397fdb2da2fb5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9dedbf2f6ae2b45606ddf8ca688a334b5456eda99799f6f17142e8d60d4a8cef5f6195213a7c5b8e868d9c30180d3b9959b8005f54c95fbe7abd2c938ac3f104', 'id': '94fc3acf-a7a9-4325-b46b-a925aab59b43', 'created_at': datetime.datetime(2026, 7, 7, 20, 50, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 50, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94fc3acf-a7a9-4325-b46b-a925aab59b43/file', 'properties': {}}, 'image_service': } Jul 07 22:50:31 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Trying to clone c7093ad0-b998-43e4-befb-b1a9ff811c07 from image 94fc3acf-a7a9-4325-b46b-a925aab59b43 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94fc3acf-a7a9-4325-b46b-a925aab59b43', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:50:31 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:50:31 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:50:31 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11c7d04-1d02-492c-8c79-4ccfa861ece1]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:31 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD Jul 07 22:50:31 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:32 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da 1073741824" returned: 0 in 1.311s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Flow 'volume_create_manager' (e1f50111-f127-4fca-b6fd-6cee9491f708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1817f1d4-6105-4975-810b-007acdaa337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1817f1d4-6105-4975-810b-007acdaa337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe1502f-3761-4ca0-9349-2e3f4a96a333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3f3f6729e44d08a8fba76ecab5d4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:32Z,use_quota=True,user_id='4a34628725c94197a5713d27a7a19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e852b219-35d7-4584-acf6-c19cc719f747),volume_type_id=e852b219-35d7-4584-acf6-c19cc719f747)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:32 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4097fdb1-345a-47d9-93dd-288c7c159200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4097fdb1-345a-47d9-93dd-288c7c159200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03cbee-f7eb-4ae1-adfc-370d68b5c1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.image.glance [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Creating Keystone auth plugin from conf {{(pid=87612) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:50:32 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD" returned: 0 in 0.930s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:32 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD Jul 07 22:50:32 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03cbee-f7eb-4ae1-adfc-370d68b5c1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfe1502f-3761-4ca0-9349-2e3f4a96a333', 'volume_name': 'volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333', 'volume_size': 1, 'image_id': 'dbae018f-bc38-4e41-be29-595bf057a344', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbae018f-bc38-4e41-be29-595bf057a344', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe9ed2efef667d42e7fdb9ca0db060d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e3f3f6729e44d08a8fba76ecab5d4ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d22a0dd6e2181bf8bc9c690401b51941b645ccd89a0cf8a0262d4d0b62f2a8d0d72236c0cc9578e03f1197fd8d368565c80e5617d5c1ec07e303c5e5a8f0fd9', 'id': 'dbae018f-bc38-4e41-be29-595bf057a344', 'created_at': datetime.datetime(2026, 7, 7, 20, 50, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbae018f-bc38-4e41-be29-595bf057a344/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db382d7-20b9-4c0e-84e7-0af9b5607d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db382d7-20b9-4c0e-84e7-0af9b5607d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da71dcd3-e944-4b9c-8465-c4530e6fc34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:32 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Volume dfe1502f-3761-4ca0-9349-2e3f4a96a333: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333', 'volume_size': 1, 'image_id': 'dbae018f-bc38-4e41-be29-595bf057a344', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbae018f-bc38-4e41-be29-595bf057a344', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe9ed2efef667d42e7fdb9ca0db060d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e3f3f6729e44d08a8fba76ecab5d4ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d22a0dd6e2181bf8bc9c690401b51941b645ccd89a0cf8a0262d4d0b62f2a8d0d72236c0cc9578e03f1197fd8d368565c80e5617d5c1ec07e303c5e5a8f0fd9', 'id': 'dbae018f-bc38-4e41-be29-595bf057a344', 'created_at': datetime.datetime(2026, 7, 7, 20, 50, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbae018f-bc38-4e41-be29-595bf057a344/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 22:50:32 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Trying to clone dfe1502f-3761-4ca0-9349-2e3f4a96a333 from image dbae018f-bc38-4e41-be29-595bf057a344 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dbae018f-bc38-4e41-be29-595bf057a344', 'metadata': {}}]). {{(pid=87612) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:50:33 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c91250-cf26-4a42-b273-ce77b4d6eb72]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:33 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da" returned: 0 in 0.955s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] <== create_volume: return (2403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.245s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897368603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052fcb4b-01ed-4d71-9e03-fa22cda011e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:28Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Creating volume 052fcb4b-01ed-4d71-9e03-fa22cda011e7 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:33 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5965da-1ada-4bcf-8bea-d4f884f4d0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03406036-db47-4763-88d5-1cc95524f5da', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16957234-337c-4175-bf7c-e2df50dd6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:33 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD Jul 07 22:50:33 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:33 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 1073741824 Jul 07 22:50:33 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:33 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Volume volume-03406036-db47-4763-88d5-1cc95524f5da (03406036-db47-4763-88d5-1cc95524f5da): created successfully Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16957234-337c-4175-bf7c-e2df50dd6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (f4c94b30-ecc9-44ef-a37e-55b3aab2fd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a842c5e4-c051-41b6-87a7-fa3df3e6fa38 tempest-CreateVolumesFromImageTest-1105446624 None] Created volume successfully. Jul 07 22:50:33 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD" returned: 1 in 0.987s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Temporary image 94fc3acf-a7a9-4325-b46b-a925aab59b43 is fetched for user 7f9c9ca5ef1748c4b745bfd889241960. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97dee8f-ccac-421b-9b1e-fab61289fa64]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:33 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD Jul 07 22:50:33 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:33 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD" returned: 0 in 0.925s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:34 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD Jul 07 22:50:34 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:34 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 1073741824" returned: 0 in 1.105s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:34 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 Jul 07 22:50:34 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:34 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD" returned: 0 in 0.905s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:34 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD Jul 07 22:50:34 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:34 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD" returned: 1 in 0.900s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Temporary image dbae018f-bc38-4e41-be29-595bf057a344 is fetched for user 4a34628725c94197a5713d27a7a19fe8. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8b2200-de6a-49d8-b59f-eff02ce3a6c3]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:35 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7" returned: 0 in 0.803s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.726s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48997461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a37a913-ef38-49ba-8557-fd3c0ec44282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9822aca2cf544c2ae24919d79a7db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:28Z,use_quota=True,user_id='cb3cf7538d17483bab98e41f420a8e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Creating volume 1a37a913-ef38-49ba-8557-fd3c0ec44282 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:35 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD Jul 07 22:50:35 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:35 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:35 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 1073741824 Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1789cb96-4b6d-4dca-baba-8fbe0a34a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:35 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4518316e-b55a-42fb-bb3c-8cfdf6bb83d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:35 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Volume volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 (052fcb4b-01ed-4d71-9e03-fa22cda011e7): created successfully Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4518316e-b55a-42fb-bb3c-8cfdf6bb83d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (471dc0a8-51f8-464a-8d02-304ed76251c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:35 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3f29b1f3-0da4-4f6f-ac8e-fc888c2c34af tempest-CreateVolumesFromImageTest-1105446624 None] Created volume successfully. Jul 07 22:50:35 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD" returned: 1 in 1.044s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:36 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD" returned: 0 in 1.120s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:36 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD Jul 07 22:50:36 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:36 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 1073741824" returned: 0 in 1.165s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:36 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 Jul 07 22:50:36 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:36 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD" returned: 1 in 0.883s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:37 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282" returned: 0 in 0.774s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7093ad0-b998-43e4-befb-b1a9ff811c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c56b9ad83a49f782397fdb2da2fb5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:31Z,use_quota=True,user_id='7f9c9ca5ef1748c4b745bfd889241960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Creating volume c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:37 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:37 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 1073741824 Jul 07 22:50:37 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e323e542-2837-45cf-b8eb-62cd7ecaa19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a37a913-ef38-49ba-8557-fd3c0ec44282', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0812f60-bfb5-4a03-b03e-bde2a6dfeef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:37 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Volume volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 (1a37a913-ef38-49ba-8557-fd3c0ec44282): created successfully Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0812f60-bfb5-4a03-b03e-bde2a6dfeef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Flow 'volume_create_manager' (e452fc0e-cfd3-4afa-9230-226283deeb89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-bfa138c6-8851-4a9f-ba02-ef048deccd0f tempest-CreateVolumesFromImageTest-1105446624 None] Created volume successfully. Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-1a37a913-ef38-49ba-8557-fd3c0ec44282-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-1a37a913-ef38-49ba-8557-fd3c0ec44282-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-quobyte-1a37a913-ef38-49ba-8557-fd3c0ec44282" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-1a37a913-ef38-49ba-8557-fd3c0ec44282" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[669404f2-6cec-430a-b39e-151b1b5183f2]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:37 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 Jul 07 22:50:37 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:38 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 1073741824" returned: 0 in 1.046s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:38 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 Jul 07 22:50:38 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:38 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282" returned: 0 in 0.852s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:38 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282 Jul 07 22:50:38 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:38 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07" returned: 0 in 0.728s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:50:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe1502f-3761-4ca0-9349-2e3f4a96a333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3f3f6729e44d08a8fba76ecab5d4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:32Z,use_quota=True,user_id='4a34628725c94197a5713d27a7a19fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e852b219-35d7-4584-acf6-c19cc719f747),volume_type_id=e852b219-35d7-4584-acf6-c19cc719f747)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Creating volume dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:39 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:39 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 1073741824 Jul 07 22:50:39 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Attempting download of 94fc3acf-a7a9-4325-b46b-a925aab59b43 ((None, [{'url': 'file:///opt/stack/data/glance/images/94fc3acf-a7a9-4325-b46b-a925aab59b43', 'metadata': {}}])) to volume c7093ad0-b998-43e4-befb-b1a9ff811c07. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[04acc430-0eb9-4d6c-9e3a-4ada59a92768]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94fc3acf-a7a9-4325-b46b-a925aab59b43_48u4vzxc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:39 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-1a37a913-ef38-49ba-8557-fd3c0ec44282" returned: 0 in 0.789s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-1a37a913-ef38-49ba-8557-fd3c0ec44282" released by "delete_volume" :: held 1.695s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:39 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94fc3acf-a7a9-4325-b46b-a925aab59b43_48u4vzxc Jul 07 22:50:39 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Created reservations ['82aeac84-5d5e-4525-86c0-16a7c195b8d3', '12147a08-edf0-4325-acf1-cc7bd959aa19', '0eef6ff6-1f1b-40a2-b2f7-13c596335402', 'ac17f350-e2cc-4fac-8a70-bbc4aef6ddbe'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:39 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:39 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-052fcb4b-01ed-4d71-9e03-fa22cda011e7-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-052fcb4b-01ed-4d71-9e03-fa22cda011e7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-quobyte-052fcb4b-01ed-4d71-9e03-fa22cda011e7" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:39 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-052fcb4b-01ed-4d71-9e03-fa22cda011e7" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5fcebe-f6c4-4b9e-ad4b-c5050bd82974]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:40 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 Jul 07 22:50:40 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:40 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94fc3acf-a7a9-4325-b46b-a925aab59b43_48u4vzxc" returned: 0 in 1.281s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94fc3acf-a7a9-4325-b46b-a925aab59b43_48u4vzxc {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:40 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.973s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Deleted volume successfully. Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e3a1d525-7f03-46d5-9566-bb0f0a2354fa tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-1a37a913-ef38-49ba-8557-fd3c0ec44282-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:40 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 1073741824" returned: 0 in 1.541s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:40 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94fc3acf-a7a9-4325-b46b-a925aab59b43_48u4vzxc Jul 07 22:50:40 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:40 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 Jul 07 22:50:40 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:41 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7" returned: 0 in 1.038s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:41 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7 Jul 07 22:50:41 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:41 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94fc3acf-a7a9-4325-b46b-a925aab59b43_48u4vzxc" returned: 1 in 0.882s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94fc3acf-a7a9-4325-b46b-a925aab59b43_48u4vzxc' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f62d45-87fa-4aef-953b-14f05aca3f66]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:41 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333" returned: 0 in 0.772s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] <== create_volume: return (2363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Attempting download of dbae018f-bc38-4e41-be29-595bf057a344 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbae018f-bc38-4e41-be29-595bf057a344', 'metadata': {}}])) to volume dfe1502f-3761-4ca0-9349-2e3f4a96a333. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:50:41 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD Jul 07 22:50:41 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7079f84-2562-4ed0-8d23-e3ded14b0075]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbae018f-bc38-4e41-be29-595bf057a344_caa0k_20 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:41 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbae018f-bc38-4e41-be29-595bf057a344_caa0k_20 Jul 07 22:50:41 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:41 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-052fcb4b-01ed-4d71-9e03-fa22cda011e7" returned: 0 in 0.807s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-052fcb4b-01ed-4d71-9e03-fa22cda011e7" released by "delete_volume" :: held 1.930s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:41 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Created reservations ['65e02307-f8a6-4a1b-88af-978945f3c9f0', '57bee6c8-8cd1-4697-a9ba-f73e96a68349', '2d4c11bb-3265-4e6a-8b0c-3bc8fa0107fb', 'ec23d6b9-6f33-4867-9786-d6b3c3c9f3ac'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:42 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:42 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-03406036-db47-4763-88d5-1cc95524f5da-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-03406036-db47-4763-88d5-1cc95524f5da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-quobyte-03406036-db47-4763-88d5-1cc95524f5da" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-03406036-db47-4763-88d5-1cc95524f5da" acquired by "delete_volume" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[47347c76-d18d-4d85-a1b1-c016f21fcd98]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:42 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD" returned: 0 in 1.195s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:42 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da Jul 07 22:50:42 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:42 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbae018f-bc38-4e41-be29-595bf057a344_caa0k_20" returned: 0 in 1.070s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbae018f-bc38-4e41-be29-595bf057a344_caa0k_20 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:42 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD Jul 07 22:50:42 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:42 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbae018f-bc38-4e41-be29-595bf057a344_caa0k_20 Jul 07 22:50:42 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:43 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.031s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:43 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Deleted volume successfully. Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-683c2554-5e3c-463a-a6e1-cd0f7d536a42 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-052fcb4b-01ed-4d71-9e03-fa22cda011e7-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:43 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD" returned: 1 in 0.880s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] 94fc3acf-a7a9-4325-b46b-a925aab59b43 was raw, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:43 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 Jul 07 22:50:43 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:43 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da" returned: 0 in 1.136s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:43 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbae018f-bc38-4e41-be29-595bf057a344_caa0k_20" returned: 1 in 0.941s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbae018f-bc38-4e41-be29-595bf057a344_caa0k_20' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc21b428-2da3-4ad6-a201-e43d19e339b9]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:43 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da Jul 07 22:50:43 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:43 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD Jul 07 22:50:43 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:44 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-03406036-db47-4763-88d5-1cc95524f5da" returned: 0 in 0.899s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-03406036-db47-4763-88d5-1cc95524f5da" released by "delete_volume" :: held 2.106s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Created reservations ['d07335f3-365f-4679-9d2c-dbaccf1e9d10', '4201bc13-1967-42ac-b7ac-821ae3bcf7c8', '61b36ef2-a007-48b6-a937-93b4aa0af8c4', '25f51f30-43ef-4713-8f6b-d68ba4666666'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:44 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07" returned: 0 in 1.145s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94fc3acf-a7a9-4325-b46b-a925aab59b43_th0gco3hdevstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:50:44 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:44 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD" returned: 0 in 1.088s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:44 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 1G Jul 07 22:50:44 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:44 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:44 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:44 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD Jul 07 22:50:44 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:45 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.694s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Deleted volume successfully. Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7be33f33-591c-4593-9bec-01194740e08d tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-03406036-db47-4763-88d5-1cc95524f5da-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:45 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD" returned: 1 in 0.879s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] dbae018f-bc38-4e41-be29-595bf057a344 was raw, converting to raw {{(pid=87612) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:45 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 Jul 07 22:50:45 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:45 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 1G" returned: 0 in 1.002s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86efca9-7e64-4990-9617-28750f77c675]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-635b815c-faf1-485d-9436-25c3e62c310e-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-635b815c-faf1-485d-9436-25c3e62c310e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-quobyte-635b815c-faf1-485d-9436-25c3e62c310e" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-635b815c-faf1-485d-9436-25c3e62c310e" acquired by "delete_volume" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7acdd4-0a54-4e18-8437-b5acf66a8ee4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:45 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 Jul 07 22:50:45 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:45 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e Jul 07 22:50:45 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:46 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333" returned: 0 in 1.023s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:46 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dbae018f-bc38-4e41-be29-595bf057a344__d_nwt1bdevstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:50:46 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:50:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:46 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 1G Jul 07 22:50:46 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:46 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07" returned: 0 in 1.116s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:46 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e" returned: 0 in 1.076s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:46 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e Jul 07 22:50:46 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:47 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 Jul 07 22:50:47 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:47 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 1G" returned: 0 in 1.164s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:47 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb33c2e-055f-4830-8f6e-361406e12278]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:47 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-635b815c-faf1-485d-9436-25c3e62c310e" returned: 0 in 1.060s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:47 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 Jul 07 22:50:47 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-635b815c-faf1-485d-9436-25c3e62c310e" released by "delete_volume" :: held 2.230s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:48 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07" returned: 1 in 1.272s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Downloaded image 94fc3acf-a7a9-4325-b46b-a925aab59b43 ((None, [{'url': 'file:///opt/stack/data/glance/images/94fc3acf-a7a9-4325-b46b-a925aab59b43', 'metadata': {}}])) to volume c7093ad0-b998-43e4-befb-b1a9ff811c07 successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Temporary image 94fc3acf-a7a9-4325-b46b-a925aab59b43 for user 7f9c9ca5ef1748c4b745bfd889241960 is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Marking volume c7093ad0-b998-43e4-befb-b1a9ff811c07 as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Copying metadata from image 94fc3acf-a7a9-4325-b46b-a925aab59b43 to c7093ad0-b998-43e4-befb-b1a9ff811c07. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Creating volume glance metadata for volume c7093ad0-b998-43e4-befb-b1a9ff811c07 backed by image 94fc3acf-a7a9-4325-b46b-a925aab59b43 with: {'image_id': '94fc3acf-a7a9-4325-b46b-a925aab59b43', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8c4fcfd5ec8defec31116b9cbeedec23', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Created reservations ['c92d4e00-cf47-4c90-b88f-a7f2100b8c47', '87d73941-b6c4-4ad8-9b09-b4d32db95f2b', 'b1b102b0-bcc1-4db3-b826-043d30365853', 'c5385064-6572-4f45-9864-fc6ab5c82269'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0adda2-3ee0-41dd-bc90-9412ab131879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7093ad0-b998-43e4-befb-b1a9ff811c07', 'volume_size': 1, 'image_id': '94fc3acf-a7a9-4325-b46b-a925aab59b43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94fc3acf-a7a9-4325-b46b-a925aab59b43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c4fcfd5ec8defec31116b9cbeedec23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50c56b9ad83a49f782397fdb2da2fb5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9dedbf2f6ae2b45606ddf8ca688a334b5456eda99799f6f17142e8d60d4a8cef5f6195213a7c5b8e868d9c30180d3b9959b8005f54c95fbe7abd2c938ac3f104', 'id': '94fc3acf-a7a9-4325-b46b-a925aab59b43', 'created_at': datetime.datetime(2026, 7, 7, 20, 50, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 50, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94fc3acf-a7a9-4325-b46b-a925aab59b43/file', 'properties': {}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9ea8b7-3ced-4098-b502-3a92f6a90892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:48 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Volume volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 (c7093ad0-b998-43e4-befb-b1a9ff811c07): created successfully Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9ea8b7-3ced-4098-b502-3a92f6a90892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Flow 'volume_create_manager' (c240d5ca-6318-489a-a770-5ab6c0d034a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5a3d3258-3cb0-46c8-9854-cd6a1bdfa00c tempest-VolumeImageDependencyTests-1466148526 None] Created volume successfully. Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:48 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:48 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:48 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333" returned: 0 in 1.134s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:49 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 Jul 07 22:50:49 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-3975c415-f3dd-4009-ac38-b4f34221f796-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:49 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.934s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:49 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Deleted volume successfully. Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-3975c415-f3dd-4009-ac38-b4f34221f796-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a1055bf7-c5b0-408d-9947-75c07f720456 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-635b815c-faf1-485d-9436-25c3e62c310e-delete_volume" released by "delete_volume" :: held 3.680s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "cinder-quobyte-3975c415-f3dd-4009-ac38-b4f34221f796" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-3975c415-f3dd-4009-ac38-b4f34221f796" acquired by "delete_volume" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Acquiring lock "cinder-c7093ad0-b998-43e4-befb-b1a9ff811c07-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb99cc-7d9f-42af-9955-4ff3c0008942]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Lock "cinder-c7093ad0-b998-43e4-befb-b1a9ff811c07-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Acquiring lock "cinder-quobyte-c7093ad0-b998-43e4-befb-b1a9ff811c07" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Lock "cinder-quobyte-c7093ad0-b998-43e4-befb-b1a9ff811c07" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:49 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 Jul 07 22:50:49 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4cd675-4d59-43d3-a537-d8d30968a43b]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:49 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 Jul 07 22:50:49 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:50 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333" returned: 1 in 1.350s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Downloaded image dbae018f-bc38-4e41-be29-595bf057a344 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbae018f-bc38-4e41-be29-595bf057a344', 'metadata': {}}])) to volume dfe1502f-3761-4ca0-9349-2e3f4a96a333 successfully. {{(pid=87612) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Temporary image dbae018f-bc38-4e41-be29-595bf057a344 for user 4a34628725c94197a5713d27a7a19fe8 is deleted. {{(pid=87612) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.volume.volume_utils [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Marking volume dfe1502f-3761-4ca0-9349-2e3f4a96a333 as bootable. {{(pid=87612) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Copying metadata from image dbae018f-bc38-4e41-be29-595bf057a344 to dfe1502f-3761-4ca0-9349-2e3f4a96a333. {{(pid=87612) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Creating volume glance metadata for volume dfe1502f-3761-4ca0-9349-2e3f4a96a333 backed by image dbae018f-bc38-4e41-be29-595bf057a344 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dbae018f-bc38-4e41-be29-595bf057a344', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bbe9ed2efef667d42e7fdb9ca0db060d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87612) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da71dcd3-e944-4b9c-8465-c4530e6fc34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333', 'volume_size': 1, 'image_id': 'dbae018f-bc38-4e41-be29-595bf057a344', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbae018f-bc38-4e41-be29-595bf057a344', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe9ed2efef667d42e7fdb9ca0db060d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e3f3f6729e44d08a8fba76ecab5d4ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d22a0dd6e2181bf8bc9c690401b51941b645ccd89a0cf8a0262d4d0b62f2a8d0d72236c0cc9578e03f1197fd8d368565c80e5617d5c1ec07e303c5e5a8f0fd9', 'id': 'dbae018f-bc38-4e41-be29-595bf057a344', 'created_at': datetime.datetime(2026, 7, 7, 20, 50, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbae018f-bc38-4e41-be29-595bf057a344/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821c3e7e-a273-486f-b986-49ffe438510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:50 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Volume volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 (dfe1502f-3761-4ca0-9349-2e3f4a96a333): created successfully Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821c3e7e-a273-486f-b986-49ffe438510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Flow 'volume_create_manager' (e1f50111-f127-4fca-b6fd-6cee9491f708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3a0be30e-3f41-44a4-a2fb-3f7b30837c28 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Created volume successfully. Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Acquiring lock "cinder-dfe1502f-3761-4ca0-9349-2e3f4a96a333-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "cinder-dfe1502f-3761-4ca0-9349-2e3f4a96a333-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:50 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796" returned: 0 in 1.309s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:50 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796 Jul 07 22:50:50 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Acquiring lock "cinder-quobyte-dfe1502f-3761-4ca0-9349-2e3f4a96a333" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "cinder-quobyte-dfe1502f-3761-4ca0-9349-2e3f4a96a333" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:50:50 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07" returned: 0 in 1.188s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:50 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bb29ea-c0e1-43ec-bc88-c1927ae3a62f]: (4, 'raw') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:50:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:51 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 Jul 07 22:50:51 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:51 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 Jul 07 22:50:51 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:52 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3975c415-f3dd-4009-ac38-b4f34221f796" returned: 0 in 1.255s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-quobyte-3975c415-f3dd-4009-ac38-b4f34221f796" released by "delete_volume" :: held 2.646s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:52 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333" returned: 0 in 1.158s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:52 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07" returned: 1 in 1.248s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Created reservations ['bfb8f42a-7548-4fd2-85ba-135f59e02524', '1193aacd-7c34-4fa4-9f28-65085344fefe', '76573b7f-8782-45e4-ac6b-4376d0898acf', '6e9979ba-4a7d-454c-9faa-c9381b229bc2'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:52 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07 Jul 07 22:50:52 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:52 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 Jul 07 22:50:52 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:52 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:52 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:53 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.912s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:53 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c7093ad0-b998-43e4-befb-b1a9ff811c07" returned: 0 in 1.047s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Deleted volume successfully. Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Lock "cinder-quobyte-c7093ad0-b998-43e4-befb-b1a9ff811c07" released by "delete_volume" :: held 3.589s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f9789138-5298-45b3-9d34-a0ac3e3772a6 tempest-CreateVolumesFromImageTest-1105446624 None] Lock "cinder-3975c415-f3dd-4009-ac38-b4f34221f796-delete_volume" released by "delete_volume" :: held 3.986s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:53 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333" returned: 1 in 1.189s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333' failed. Not Retrying. {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Created reservations ['8711c151-2187-46df-8586-a73af70a604f', '97876fbe-7ccc-443e-96a1-de39f8110ee3', '2b4e5966-472c-401f-8cea-9ecf6062ee31', '435dee7d-dcee-4239-b5e8-9ee000ce98ac'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:53 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333 Jul 07 22:50:53 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:53 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:53 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:54 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-dfe1502f-3761-4ca0-9349-2e3f4a96a333" returned: 0 in 0.956s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "cinder-quobyte-dfe1502f-3761-4ca0-9349-2e3f4a96a333" released by "delete_volume" :: held 3.434s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:54 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Created reservations ['0828b65d-5350-4577-bf1f-7c9caee90d55', '41305698-997c-455a-bba4-f42d843cc153', '5fdae86f-22fa-4829-b461-dfc5ffc9c893', '3ffe432e-5cf0-458f-b858-c80a8e28f4fc'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.990s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:54 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Deleted volume successfully. Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f2aa35c-a2dc-44c2-9549-5aca46850011 tempest-VolumeImageDependencyTests-1466148526 None] Lock "cinder-c7093ad0-b998-43e4-befb-b1a9ff811c07-delete_volume" released by "delete_volume" :: held 4.948s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:54 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:54 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:55 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.957s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:55 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Deleted volume successfully. Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1f198aa8-acd7-48af-959d-84f050d8dab3 tempest-VolumeAndVolumeTypeFromImageTest-985123877 None] Lock "cinder-dfe1502f-3761-4ca0-9349-2e3f4a96a333-delete_volume" released by "delete_volume" :: held 4.844s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:55 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:50:55 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:50:56 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 07 22:50:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.929s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:50:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:50:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:50:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:50:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (b0081a1b-2c54-4ce3-a237-9b344e35ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c6ac9e-5f1f-4b8f-a3e8-6c508392ba81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c6ac9e-5f1f-4b8f-a3e8-6c508392ba81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1898365866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f8d45c-7fb0-49d3-a0f4-a86a191617b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:59Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a2b876-c7e8-4cbe-8675-5e80f9fe5163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a2b876-c7e8-4cbe-8675-5e80f9fe5163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb2148f-08bf-4852-a896-0176541ca640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb2148f-08bf-4852-a896-0176541ca640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f8d45c-7fb0-49d3-a0f4-a86a191617b3', 'volume_name': 'volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f4b691-f716-4775-83f4-e2b0744045cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f4b691-f716-4775-83f4-e2b0744045cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c11cb34-3cbe-462c-ac0d-9961d578ed0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:50:59 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume e3f8d45c-7fb0-49d3-a0f4-a86a191617b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3', 'volume_size': 1} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1898365866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f8d45c-7fb0-49d3-a0f4-a86a191617b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:59Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Creating volume e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:50:59 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:50:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:50:59 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 1073741824 Jul 07 22:50:59 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:00 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 1073741824" returned: 0 in 1.372s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:00 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 Jul 07 22:51:00 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (1e3fe817-2fac-4486-8914-e846462a07ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8941c6b-96a5-48e2-8165-1c74cbae27c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8941c6b-96a5-48e2-8165-1c74cbae27c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427208675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcd7160-4aea-41c1-aafb-4cf734587fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:01Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff044b8f-fed7-4591-9e55-5a2169811532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff044b8f-fed7-4591-9e55-5a2169811532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefbc1bd-6c91-44a8-9a28-c22012109bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefbc1bd-6c91-44a8-9a28-c22012109bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcd7160-4aea-41c1-aafb-4cf734587fc0', 'volume_name': 'volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e022fcb8-6a4c-4745-aed7-dd3d2d851985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e022fcb8-6a4c-4745-aed7-dd3d2d851985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b19d43-8c60-4cf7-a47a-ab63ee5bd26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:01 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Volume 9dcd7160-4aea-41c1-aafb-4cf734587fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0', 'volume_size': 1} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:01 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3" returned: 0 in 1.021s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] <== create_volume: return (2448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.450s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.228s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427208675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcd7160-4aea-41c1-aafb-4cf734587fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:01Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Creating volume 9dcd7160-4aea-41c1-aafb-4cf734587fc0 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:01 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:01 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 1073741824 Jul 07 22:51:01 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c11cb34-3cbe-462c-ac0d-9961d578ed0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc912957-8dc1-4505-a1f3-29553126bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:01 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 (e3f8d45c-7fb0-49d3-a0f4-a86a191617b3): created successfully Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc912957-8dc1-4505-a1f3-29553126bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:01 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (b0081a1b-2c54-4ce3-a237-9b344e35ad19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:01 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3db7003f-c218-4885-bb35-e35da2c6882a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created volume successfully. Jul 07 22:51:02 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 1073741824" returned: 0 in 1.132s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:02 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 Jul 07 22:51:02 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (35e67b5e-dda5-476b-828c-d4db3229397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d87ef16-cc98-4e9f-8bfb-3d509d0dedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d87ef16-cc98-4e9f-8bfb-3d509d0dedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1162226047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6b2630-b926-4c16-b0e0-eceb7bc49dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:03Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b50cae-1265-4d8f-9c8c-1c5a2a809dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b50cae-1265-4d8f-9c8c-1c5a2a809dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24eb4e11-7531-4ce5-bdfe-fcb22161586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24eb4e11-7531-4ce5-bdfe-fcb22161586f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6b2630-b926-4c16-b0e0-eceb7bc49dcf', 'volume_name': 'volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242990a0-bd69-4886-a052-225e7f69a65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242990a0-bd69-4886-a052-225e7f69a65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baf00ab-1f67-4940-93e8-86b499417c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume da6b2630-b926-4c16-b0e0-eceb7bc49dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf', 'volume_size': 1} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (302b8696-f405-46b8-a2d0-769d0a2b55e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cab2ee9-c749-4970-b60e-b1a1fa75d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cab2ee9-c749-4970-b60e-b1a1fa75d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913657420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04f2e42-c8e4-44b4-8c5f-5ee0633af28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:03Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0965ab92-c4ad-4b80-b979-586fc51374a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0965ab92-c4ad-4b80-b979-586fc51374a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cf57e9-874e-4e52-939f-0a10a0e2999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cf57e9-874e-4e52-939f-0a10a0e2999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04f2e42-c8e4-44b4-8c5f-5ee0633af28f', 'volume_name': 'volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25789dcb-befe-4472-bf30-8fbde723bb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25789dcb-befe-4472-bf30-8fbde723bb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acb1143-ddba-48d0-afaa-75fadc3a3024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume d04f2e42-c8e4-44b4-8c5f-5ee0633af28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f', 'volume_size': 1} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (0765f501-3d3a-4e7e-81c3-12378e05a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8de926-bb4b-4225-b5a9-68fe1a7d2301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8de926-bb4b-4225-b5a9-68fe1a7d2301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-309267153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003b4c07-a717-4c23-941f-fede290b85a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:04Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83494b1-ef0a-40f5-9db7-22c962cc84b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83494b1-ef0a-40f5-9db7-22c962cc84b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5694c00e-9798-4fbb-b85c-018484337b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5694c00e-9798-4fbb-b85c-018484337b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003b4c07-a717-4c23-941f-fede290b85a6', 'volume_name': 'volume-003b4c07-a717-4c23-941f-fede290b85a6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899b03ee-72d3-4f5e-bbe8-d8d4d3fe807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899b03ee-72d3-4f5e-bbe8-d8d4d3fe807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60013e6d-6903-40f9-b037-61fd897047ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:03 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume 003b4c07-a717-4c23-941f-fede290b85a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003b4c07-a717-4c23-941f-fede290b85a6', 'volume_size': 1} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:03 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0" returned: 0 in 1.055s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] <== create_volume: return (2263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1162226047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6b2630-b926-4c16-b0e0-eceb7bc49dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:03Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Creating volume da6b2630-b926-4c16-b0e0-eceb7bc49dcf {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:03 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:04 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf 1073741824 Jul 07 22:51:04 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b19d43-8c60-4cf7-a47a-ab63ee5bd26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f1be81-d47a-46f4-bd62-9f40b014d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Volume volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 (9dcd7160-4aea-41c1-aafb-4cf734587fc0): created successfully Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f1be81-d47a-46f4-bd62-9f40b014d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (1e3fe817-2fac-4486-8914-e846462a07ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (a6e0fe7f-52c6-473d-9b09-776c100197dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96512810-0615-4f42-9cd9-7026a7219ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8291ab23-b0d6-4d87-a66c-fec73558f86b tempest-ProjectReaderTests-1081494454 None] Created volume successfully. Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96512810-0615-4f42-9cd9-7026a7219ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1590027520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c15f0d6-5775-49ac-900c-bb8d18fae08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:04Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d04f24-6710-4bf7-8f20-0ade4318f840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d04f24-6710-4bf7-8f20-0ade4318f840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b038c7c2-e56e-40e8-8d8d-60c89ef2d308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b038c7c2-e56e-40e8-8d8d-60c89ef2d308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c15f0d6-5775-49ac-900c-bb8d18fae08f', 'volume_name': 'volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed0036f-7260-4c0e-b36e-b1cdc37c5f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed0036f-7260-4c0e-b36e-b1cdc37c5f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e3c79f-fa39-4606-a611-fde69a3931e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume 9c15f0d6-5775-49ac-900c-bb8d18fae08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f', 'volume_size': 1} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (bd890ae0-b0e6-4889-b327-efb2e23cf4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a4f344-6c71-42ef-a494-979a0f60543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a4f344-6c71-42ef-a494-979a0f60543a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-588095941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98271470-15db-4b02-b9e0-a7aba80ab8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:04Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0845fd30-2bd1-4c8c-aed2-44b28638e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0845fd30-2bd1-4c8c-aed2-44b28638e958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3393c485-1487-4123-9e45-65aef7f9c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3393c485-1487-4123-9e45-65aef7f9c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98271470-15db-4b02-b9e0-a7aba80ab8a1', 'volume_name': 'volume-98271470-15db-4b02-b9e0-a7aba80ab8a1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef2a600-5b74-4386-9f1b-d8d59ddada82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef2a600-5b74-4386-9f1b-d8d59ddada82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafd55f9-6320-46c0-8f07-2ce85bc8b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume 98271470-15db-4b02-b9e0-a7aba80ab8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98271470-15db-4b02-b9e0-a7aba80ab8a1', 'volume_size': 1} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (09338d7d-76d8-4289-bc21-b3351502a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81863e4-6847-408a-9dad-f001babc1036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81863e4-6847-408a-9dad-f001babc1036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1349941694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9830b3-d2c6-4187-a5b7-00115a08831c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:05Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156b9ade-38b6-440f-98bc-a340aff7750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156b9ade-38b6-440f-98bc-a340aff7750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c95ab29-e0ca-42ef-93c7-a223355a569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c95ab29-e0ca-42ef-93c7-a223355a569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9830b3-d2c6-4187-a5b7-00115a08831c', 'volume_name': 'volume-3c9830b3-d2c6-4187-a5b7-00115a08831c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d866556-a3ac-4e7d-b862-7dd94de050ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d866556-a3ac-4e7d-b862-7dd94de050ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b137fd9-3e34-4df6-ac5b-89f6c83061fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:05 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume 3c9830b3-d2c6-4187-a5b7-00115a08831c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9830b3-d2c6-4187-a5b7-00115a08831c', 'volume_size': 1} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:05 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf 1073741824" returned: 0 in 1.251s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:05 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf Jul 07 22:51:05 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:05 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf" returned: 0 in 0.662s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913657420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04f2e42-c8e4-44b4-8c5f-5ee0633af28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:03Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Creating volume d04f2e42-c8e4-44b4-8c5f-5ee0633af28f {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:05 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:05 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f 1073741824 Jul 07 22:51:05 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baf00ab-1f67-4940-93e8-86b499417c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:05 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d9f5a8-1623-4686-afd3-d5241c77a1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:06 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf (da6b2630-b926-4c16-b0e0-eceb7bc49dcf): created successfully Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d9f5a8-1623-4686-afd3-d5241c77a1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (35e67b5e-dda5-476b-828c-d4db3229397b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:06 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4dca5908-4ae8-40b2-9145-82740fb95971 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created volume successfully. Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Flow 'volume_create_manager' (4da30440-76fd-4a9d-a2dc-58de2432584b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b1a742-b0d0-475d-99a4-49d498b06f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b1a742-b0d0-475d-99a4-49d498b06f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024316877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd299fd-c0a6-475c-ba9f-668ca506f8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e919fd70988451197328b64762fcebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:07Z,use_quota=True,user_id='4cd28c07874c4c9cb987b4ce768ebb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06659bd-a599-46f3-bb5a-2d85ce64072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06659bd-a599-46f3-bb5a-2d85ce64072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0437d651-7b8c-4de9-996c-92a480558173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0437d651-7b8c-4de9-996c-92a480558173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd299fd-c0a6-475c-ba9f-668ca506f8c6', 'volume_name': 'volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb9a9d9-e9e9-408c-8e18-7898596e152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb9a9d9-e9e9-408c-8e18-7898596e152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04e9b43-386c-4486-aa04-8dc2ebc91a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:06 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Volume fbd299fd-c0a6-475c-ba9f-668ca506f8c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6', 'volume_size': 1} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:06 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f 1073741824" returned: 0 in 0.889s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:06 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f Jul 07 22:51:06 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:07 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" returned: 0 in 0.698s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.726s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-309267153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003b4c07-a717-4c23-941f-fede290b85a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:04Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Creating volume 003b4c07-a717-4c23-941f-fede290b85a6 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:07 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:07 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 1073741824 Jul 07 22:51:07 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acb1143-ddba-48d0-afaa-75fadc3a3024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546f9c97-663d-481c-9fdf-0ec85bbf4cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f (d04f2e42-c8e4-44b4-8c5f-5ee0633af28f): created successfully Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546f9c97-663d-481c-9fdf-0ec85bbf4cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (302b8696-f405-46b8-a2d0-769d0a2b55e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d89cd551-a821-4c35-91ae-a3488442519b tempest-CreateVolumesFromSnapshotTest-353593716 None] Created volume successfully. Jul 07 22:51:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:08 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 1073741824" returned: 0 in 0.913s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:08 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 Jul 07 22:51:08 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:09 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6" returned: 0 in 0.715s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1590027520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c15f0d6-5775-49ac-900c-bb8d18fae08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:04Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Creating volume 9c15f0d6-5775-49ac-900c-bb8d18fae08f {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:09 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60013e6d-6903-40f9-b037-61fd897047ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003b4c07-a717-4c23-941f-fede290b85a6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ead3543-06f6-4db2-93a9-606bdadc6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:09 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f 1073741824 Jul 07 22:51:09 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:09 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume volume-003b4c07-a717-4c23-941f-fede290b85a6 (003b4c07-a717-4c23-941f-fede290b85a6): created successfully Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ead3543-06f6-4db2-93a9-606bdadc6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (0765f501-3d3a-4e7e-81c3-12378e05a240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:09 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b9da6e7c-f483-4443-90fe-0b8939909a71 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created volume successfully. Jul 07 22:51:10 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f 1073741824" returned: 0 in 0.845s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:10 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f Jul 07 22:51:10 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:10 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f" returned: 0 in 0.636s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.180s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-588095941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98271470-15db-4b02-b9e0-a7aba80ab8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:04Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Creating volume 98271470-15db-4b02-b9e0-a7aba80ab8a1 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:10 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:10 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 1073741824 Jul 07 22:51:10 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e3c79f-fa39-4606-a611-fde69a3931e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03586bec-c371-4e5e-bea6-3994be586ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:10 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f (9c15f0d6-5775-49ac-900c-bb8d18fae08f): created successfully Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03586bec-c371-4e5e-bea6-3994be586ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:10 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (a6e0fe7f-52c6-473d-9b09-776c100197dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:10 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2ba5bcd6-a8e0-4004-8dc7-bb922d18baa1 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created volume successfully. Jul 07 22:51:11 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 1073741824" returned: 0 in 0.907s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:11 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 Jul 07 22:51:11 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:12 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1" returned: 0 in 0.665s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.381s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1349941694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9830b3-d2c6-4187-a5b7-00115a08831c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15995dc03eac46b9903538038386e83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:05Z,use_quota=True,user_id='f118a12817a84e5ba07995b035887e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Creating volume 3c9830b3-d2c6-4187-a5b7-00115a08831c {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:12 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafd55f9-6320-46c0-8f07-2ce85bc8b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98271470-15db-4b02-b9e0-a7aba80ab8a1', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:12 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c 1073741824 Jul 07 22:51:12 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ca14a8-7660-4259-8fbc-4333deb37e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:12 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 (98271470-15db-4b02-b9e0-a7aba80ab8a1): created successfully Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ca14a8-7660-4259-8fbc-4333deb37e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:12 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (bd890ae0-b0e6-4889-b327-efb2e23cf4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:12 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-22c7133d-3946-40ac-b454-9b67b936af22 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created volume successfully. Jul 07 22:51:13 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c 1073741824" returned: 0 in 0.850s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:13 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c Jul 07 22:51:13 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:13 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c" returned: 0 in 0.627s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.787s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b137fd9-3e34-4df6-ac5b-89f6c83061fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9830b3-d2c6-4187-a5b7-00115a08831c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f46eb5-7b5d-458b-9f2f-a145745144e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Creating offline snapshot 2d87deb5-f7f9-4076-af54-b83a9928b1e4 of volume 9dcd7160-4aea-41c1-aafb-4cf734587fc0 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:51:14 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Volume volume-3c9830b3-d2c6-4187-a5b7-00115a08831c (3c9830b3-d2c6-4187-a5b7-00115a08831c): created successfully Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f46eb5-7b5d-458b-9f2f-a145745144e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Flow 'volume_create_manager' (09338d7d-76d8-4289-bc21-b3351502a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2208a670-fc92-459e-90aa-d3e833f8569d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f8516047-0d8b-4c26-94a3-e667365dd685 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created volume successfully. Jul 07 22:51:14 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 Jul 07 22:51:14 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-3c9830b3-d2c6-4187-a5b7-00115a08831c-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-3c9830b3-d2c6-4187-a5b7-00115a08831c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-quobyte-3c9830b3-d2c6-4187-a5b7-00115a08831c" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-3c9830b3-d2c6-4187-a5b7-00115a08831c" acquired by "delete_volume" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4af14-4bcd-4dce-bf59-9c053e44c3be]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:14 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0" returned: 0 in 0.799s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:14 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 1G Jul 07 22:51:14 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:14 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c Jul 07 22:51:14 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:15 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c" returned: 0 in 0.788s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:15 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c Jul 07 22:51:15 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:15 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 1G" returned: 0 in 0.892s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:15 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 Jul 07 22:51:15 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:16 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3c9830b3-d2c6-4187-a5b7-00115a08831c" returned: 0 in 0.661s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-3c9830b3-d2c6-4187-a5b7-00115a08831c" released by "delete_volume" :: held 1.489s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created reservations ['f6496340-0122-443a-bc22-75542ba65d15', '56d9c822-a5c7-47da-b972-ade80c86430a', 'e9debaa3-148f-4a7d-85c9-11779ed1354e', '65c07803-187e-48c1-b3ca-e91f7d6baeea'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:16 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:16 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:16 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4" returned: 0 in 0.823s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:16 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 is being set with open permissions: ugo+rw Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:16 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 Jul 07 22:51:16 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-98271470-15db-4b02-b9e0-a7aba80ab8a1-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-98271470-15db-4b02-b9e0-a7aba80ab8a1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-quobyte-98271470-15db-4b02-b9e0-a7aba80ab8a1" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-98271470-15db-4b02-b9e0-a7aba80ab8a1" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[be47e0f2-f597-4d14-94a5-64f22f04d64e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:17 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Deleted volume successfully. Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-8ca4d5db-29e9-443f-b119-7e2050f2ff21 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-3c9830b3-d2c6-4187-a5b7-00115a08831c-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:17 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 Jul 07 22:51:17 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:17 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4" returned: 0 in 0.757s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:17 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.info Jul 07 22:51:17 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:17 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1" returned: 0 in 0.890s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:18 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1 Jul 07 22:51:18 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:18 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.info" returned: 0 in 0.742s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:18 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.info is being set with open permissions: ugo+rw Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:18 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.info Jul 07 22:51:18 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:18 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-98271470-15db-4b02-b9e0-a7aba80ab8a1" returned: 0 in 0.768s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-98271470-15db-4b02-b9e0-a7aba80ab8a1" released by "delete_volume" :: held 1.710s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=91,cinder:UPDATE=101,cinder:DELETE=11,cinder:INSERT=39 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:51:18 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.info" returned: 0 in 0.747s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.880s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.018s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024316877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd299fd-c0a6-475c-ba9f-668ca506f8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e919fd70988451197328b64762fcebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:07Z,use_quota=True,user_id='4cd28c07874c4c9cb987b4ce768ebb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Creating volume fbd299fd-c0a6-475c-ba9f-668ca506f8c6 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:18 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created reservations ['9d63ae4a-c931-4c99-8ea2-d8d5728f50ba', '2c20ea79-0d8b-4d7f-8609-5c258ce4d347', '797dcda8-9035-40e4-bdc9-c2e90a2fe30b', '9aeca3eb-085a-4821-8b37-04d509036f79'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:18 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 1073741824 Jul 07 22:51:18 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:18 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a0ed6e1f-0bfe-4dcb-9461-6430b22e4927 tempest-ProjectReaderTests-1081494454 None] Create snapshot completed successfully Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:19 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:19 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-9c15f0d6-5775-49ac-900c-bb8d18fae08f-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-9c15f0d6-5775-49ac-900c-bb8d18fae08f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=137,cinder:SELECT=91,cinder:INSERT=29,cinder:DELETE=12 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-quobyte-9c15f0d6-5775-49ac-900c-bb8d18fae08f" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-9c15f0d6-5775-49ac-900c-bb8d18fae08f" acquired by "delete_volume" :: waited 0.036s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d26f011-75af-474e-8ba9-7bea8d557648]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:19 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f Jul 07 22:51:19 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:19 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.736s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Deleted volume successfully. Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-db6ddd52-011a-41e9-b2b6-aefa0cc5869f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-98271470-15db-4b02-b9e0-a7aba80ab8a1-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:19 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 1073741824" returned: 0 in 1.086s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-2d87deb5-f7f9-4076-af54-b83a9928b1e4-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-2d87deb5-f7f9-4076-af54-b83a9928b1e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-9dcd7160-4aea-41c1-aafb-4cf734587fc0" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-9dcd7160-4aea-41c1-aafb-4cf734587fc0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-2d87deb5-f7f9-4076-af54-b83a9928b1e4" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-2d87deb5-f7f9-4076-af54-b83a9928b1e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:20 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 Jul 07 22:51:20 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Deleting offline snapshot 2d87deb5-f7f9-4076-af54-b83a9928b1e4 of volume 9dcd7160-4aea-41c1-aafb-4cf734587fc0 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] snapshot_file for this snap is: volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da55714-5857-45c6-a6ab-c3f125db7180]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:20 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 Jul 07 22:51:20 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:20 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f" returned: 0 in 0.986s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:20 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f Jul 07 22:51:20 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:20 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6" returned: 0 in 0.707s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.227s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Creating offline snapshot 80a5ed4f-6a22-4a45-9ce8-27a9d967674a of volume d04f2e42-c8e4-44b4-8c5f-5ee0633af28f {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04e9b43-386c-4486-aa04-8dc2ebc91a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b423f2c0-7a30-477d-9cd4-e5dcd6cac2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f2f5b9-6eb6-47aa-b19d-14fa4b8ae294]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:20 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Volume volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 (fbd299fd-c0a6-475c-ba9f-668ca506f8c6): created successfully Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b423f2c0-7a30-477d-9cd4-e5dcd6cac2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Flow 'volume_create_manager' (4da30440-76fd-4a9d-a2dc-58de2432584b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:20 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-247e8485-e72c-4bc0-93a2-0a9ecf2abf82 tempest-ProjectReaderTests-669058302 None] Created volume successfully. Jul 07 22:51:20 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f Jul 07 22:51:20 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:20 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4" returned: 0 in 0.876s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:20 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[609f8d66-7659-4353-903d-eddd6bcd34e0]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:21 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9c15f0d6-5775-49ac-900c-bb8d18fae08f" returned: 0 in 0.782s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:21 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 Jul 07 22:51:21 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-9c15f0d6-5775-49ac-900c-bb8d18fae08f" released by "delete_volume" :: held 1.815s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created reservations ['f71e73bb-c19e-4747-8149-faeac42c5c34', '1b35182b-b390-46ce-8a16-c311cd07bce8', '5201790e-a426-4131-81b1-77755018c8d4', '1145cc07-335c-4b8d-8906-5e2f7f9019aa'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:21 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:21 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-003b4c07-a717-4c23-941f-fede290b85a6-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-003b4c07-a717-4c23-941f-fede290b85a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-quobyte-003b4c07-a717-4c23-941f-fede290b85a6" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-003b4c07-a717-4c23-941f-fede290b85a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:21 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" returned: 0 in 0.915s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3256d7c2-df0a-4f92-8a9d-f192bd892611]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:21 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a 1G Jul 07 22:51:21 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:21 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 Jul 07 22:51:21 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Acquiring lock "cinder-fbd299fd-c0a6-475c-ba9f-668ca506f8c6-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Lock "cinder-fbd299fd-c0a6-475c-ba9f-668ca506f8c6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:22 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.900s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Deleted volume successfully. Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Acquiring lock "cinder-quobyte-fbd299fd-c0a6-475c-ba9f-668ca506f8c6" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Lock "cinder-quobyte-fbd299fd-c0a6-475c-ba9f-668ca506f8c6" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02760d2-fbff-456e-b90e-13af2821d19f tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-9c15f0d6-5775-49ac-900c-bb8d18fae08f-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d292a17-dd43-4157-a99e-7ec13b16f928]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:22 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0" returned: 0 in 1.336s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:22 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 Jul 07 22:51:22 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:22 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 Jul 07 22:51:22 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:22 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6" returned: 0 in 1.024s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:22 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6 Jul 07 22:51:22 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:22 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a 1G" returned: 0 in 1.082s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:22 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a Jul 07 22:51:22 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:23 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6" returned: 0 in 1.034s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:23 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6 Jul 07 22:51:23 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:23 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4" returned: 0 in 1.043s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:23 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4 Jul 07 22:51:23 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:23 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-003b4c07-a717-4c23-941f-fede290b85a6" returned: 0 in 0.796s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-003b4c07-a717-4c23-941f-fede290b85a6" released by "delete_volume" :: held 1.889s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created reservations ['60679807-cf22-4b8c-8c39-20c35392a4ed', '6aeb1b2c-23ae-44e7-a24f-c31575e5c2f0', '24cc10cb-e71d-42cb-a4f7-7d77442d3535', 'd1a280a8-b28c-4888-b605-daf362d42e6d'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:23 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a" returned: 0 in 0.849s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:23 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a is being set with open permissions: ugo+rw Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:23 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a Jul 07 22:51:23 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:23 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:23 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-da6b2630-b926-4c16-b0e0-eceb7bc49dcf-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-da6b2630-b926-4c16-b0e0-eceb7bc49dcf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-quobyte-da6b2630-b926-4c16-b0e0-eceb7bc49dcf" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-da6b2630-b926-4c16-b0e0-eceb7bc49dcf" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1960920-5dde-47e5-9109-b599a4d2fed0]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:24 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-fbd299fd-c0a6-475c-ba9f-668ca506f8c6" returned: 0 in 0.968s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Lock "cinder-quobyte-fbd299fd-c0a6-475c-ba9f-668ca506f8c6" released by "delete_volume" :: held 2.067s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:24 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf Jul 07 22:51:24 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:24 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0.2d87deb5-f7f9-4076-af54-b83a9928b1e4" returned: 0 in 1.045s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:24 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Created reservations ['106973aa-ec92-407e-9593-d33e1820f689', 'bd852f7e-34f4-45db-aafc-53b84e2386ce', '27e42d10-916b-4b37-bc82-37c62ac087ca', '19c0f3ce-75d2-4cc0-8991-e0d158b55614'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a" returned: 0 in 0.873s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-2d87deb5-f7f9-4076-af54-b83a9928b1e4" released by "_delete_snapshot" :: held 4.460s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-9dcd7160-4aea-41c1-aafb-4cf734587fc0" released by "delete_snapshot" :: held 4.498s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:24 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.info Jul 07 22:51:24 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Created reservations ['42f2fd8d-b47f-4841-b796-2753b59c9f47', '9568f55a-c9c3-41df-8733-b2904cc45ae9', '7bdd7eea-9663-4d7e-a5ee-2b0faf1a2191', '06760e66-c839-4d2e-b327-52e636650575'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:24 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:24 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Delete snapshot completed successfully. Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d26ff4c2-869c-484b-9879-f684bc042fa0 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-2d87deb5-f7f9-4076-af54-b83a9928b1e4-delete_snapshot" released by "delete_snapshot" :: held 4.803s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:24 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.087s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Deleted volume successfully. Jul 07 22:51:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-58a4342f-518b-4454-9ab7-802c1e2649ed tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-003b4c07-a717-4c23-941f-fede290b85a6-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:25 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf" returned: 0 in 0.990s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:25 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf Jul 07 22:51:25 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-9dcd7160-4aea-41c1-aafb-4cf734587fc0-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-9dcd7160-4aea-41c1-aafb-4cf734587fc0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-9dcd7160-4aea-41c1-aafb-4cf734587fc0" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-9dcd7160-4aea-41c1-aafb-4cf734587fc0" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:25 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.828s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:25 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Deleted volume successfully. Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44446ca-20c7-42c4-993b-050acb78863e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:25 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-72c289ec-fd8a-4844-9b66-17485b6d0712 tempest-ProjectReaderTests-669058302 None] Lock "cinder-fbd299fd-c0a6-475c-ba9f-668ca506f8c6-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.info" returned: 0 in 0.980s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:25 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.info is being set with open permissions: ugo+rw Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:25 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.info Jul 07 22:51:25 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:25 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 Jul 07 22:51:25 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:25 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-da6b2630-b926-4c16-b0e0-eceb7bc49dcf" returned: 0 in 0.824s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-da6b2630-b926-4c16-b0e0-eceb7bc49dcf" released by "delete_volume" :: held 1.896s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created reservations ['1029f39f-b106-4b47-acce-3d68116821f4', '90432eac-59c6-442f-8ae4-cbb7b48c7508', '1bd4bc42-e517-4614-8998-75621d76049d', 'f89a5164-7626-49b3-9f4b-30a6e8beaed4'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Flow 'volume_create_manager' (838203bd-740e-4109-98ac-9b0f05e16498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e887c7-c68d-4d0b-a889-10d35e5cf009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e887c7-c68d-4d0b-a889-10d35e5cf009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-896753628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17007866-8f9a-47bd-8b5b-44de95acaad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e919fd70988451197328b64762fcebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:26Z,use_quota=True,user_id='4cd28c07874c4c9cb987b4ce768ebb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a86d220-f388-4aa9-883a-f02eb4f72585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a86d220-f388-4aa9-883a-f02eb4f72585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e5db66-e055-488e-903c-0b3453b5a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e5db66-e055-488e-903c-0b3453b5a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17007866-8f9a-47bd-8b5b-44de95acaad3', 'volume_name': 'volume-17007866-8f9a-47bd-8b5b-44de95acaad3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac14a3e-2d7c-47dd-9126-4df7345fe386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac14a3e-2d7c-47dd-9126-4df7345fe386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5d910c-a059-4e4c-81f8-c83e6740d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:26 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Volume 17007866-8f9a-47bd-8b5b-44de95acaad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17007866-8f9a-47bd-8b5b-44de95acaad3', 'volume_size': 1} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:26 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:26 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "cinder-quobyte-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaa45c6-779a-459b-a311-f932de841829]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:26 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.info" returned: 0 in 1.002s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:26 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 Jul 07 22:51:26 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:26 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.861s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-896753628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17007866-8f9a-47bd-8b5b-44de95acaad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e919fd70988451197328b64762fcebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:26Z,use_quota=True,user_id='4cd28c07874c4c9cb987b4ce768ebb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Creating volume 17007866-8f9a-47bd-8b5b-44de95acaad3 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:26 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0" returned: 0 in 1.108s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:26 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 1073741824 Jul 07 22:51:26 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:26 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0 Jul 07 22:51:26 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3fa5095d-dbfc-42aa-903d-7705243e1cc9 tempest-CreateVolumesFromSnapshotTest-353593716 None] Create snapshot completed successfully Jul 07 22:51:27 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.943s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:27 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Deleted volume successfully. Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-2d184d13-9bd3-4207-92aa-d3b063808323 tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-da6b2630-b926-4c16-b0e0-eceb7bc49dcf-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:27 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3" returned: 0 in 0.997s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:27 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-9dcd7160-4aea-41c1-aafb-4cf734587fc0" returned: 0 in 0.859s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:27 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3 Jul 07 22:51:27 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-9dcd7160-4aea-41c1-aafb-4cf734587fc0" released by "delete_volume" :: held 2.057s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Created reservations ['e35f5a28-905e-4db0-8b43-e61f6a9d80bc', '2ebc0112-1692-4252-ad7c-e0f8e7489cfd', 'fef168e6-bf41-4736-b050-9444af50ad5b', 'b34bcfaf-68c3-4ed1-8b15-a12addbdc5a5'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:27 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:27 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:27 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 1073741824" returned: 0 in 1.234s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:27 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 Jul 07 22:51:27 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (fe2a8c0e-8d5d-491f-8699-882b382c32f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c77d13-e6f1-4432-ba0d-c8349395fb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c77d13-e6f1-4432-ba0d-c8349395fb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2117219075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:28Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28e3ff9-6808-4206-b3f8-84bf2c06e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28e3ff9-6808-4206-b3f8-84bf2c06e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850ee3c4-d1f7-4901-aec0-72888f5b1b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850ee3c4-d1f7-4901-aec0-72888f5b1b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05', 'volume_name': 'volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0f9f2e-1664-48aa-9f0a-f0a63f11d306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0f9f2e-1664-48aa-9f0a-f0a63f11d306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091bb5a8-89f7-40f6-975f-ccc00a7f299d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05', 'volume_size': 1} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:28 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (961d6ada-b5b1-4495-a359-6101b774e0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784cf7c2-3ea0-4bb7-aac5-55481859d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3" returned: 0 in 1.233s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784cf7c2-3ea0-4bb7-aac5-55481859d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2042625077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d047b5-ef6d-4163-8e9c-0daf99cff601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:28Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9221299-1130-47d2-9209-88e2c261b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9221299-1130-47d2-9209-88e2c261b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee972df-099c-443d-85f8-42c89503de00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee972df-099c-443d-85f8-42c89503de00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d047b5-ef6d-4163-8e9c-0daf99cff601', 'volume_name': 'volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84aa27ec-3717-4f75-ac8e-3dc3b1fbb3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84aa27ec-3717-4f75-ac8e-3dc3b1fbb3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15bd7f4-e7e9-480b-9513-f9c01bd83e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:28 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume f1d047b5-ef6d-4163-8e9c-0daf99cff601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601', 'volume_size': 1} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-quobyte-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3" released by "delete_volume" :: held 2.375s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.120s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:28 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Deleted volume successfully. Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c779c88-c0bb-485c-a5a5-2d73cc560de2 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-9dcd7160-4aea-41c1-aafb-4cf734587fc0-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Created reservations ['723a5366-1c24-47e2-85e6-13803cbc9201', '8e965c28-8a95-432c-92d6-92fcee6e2067', 'a8451c9b-f0d9-46dd-8646-3af85ab181bf', '8455c433-d954-4cfe-92d7-38099d3aa656'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:28 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3" returned: 0 in 1.051s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2117219075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:28Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Creating volume ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:28 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5d910c-a059-4e4c-81f8-c83e6740d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17007866-8f9a-47bd-8b5b-44de95acaad3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:29 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 1073741824 Jul 07 22:51:29 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc0d7b1-f0dc-4633-a1a7-3ffc9fe20323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:29 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Volume volume-17007866-8f9a-47bd-8b5b-44de95acaad3 (17007866-8f9a-47bd-8b5b-44de95acaad3): created successfully Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc0d7b1-f0dc-4633-a1a7-3ffc9fe20323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Flow 'volume_create_manager' (838203bd-740e-4109-98ac-9b0f05e16498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e88a3b44-5fb9-4f66-a38e-d1a55bd943b8 tempest-ProjectReaderTests-669058302 None] Created volume successfully. Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:29 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:29 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (278fc3bb-fbc3-4cb7-a3d2-20c655137760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0d27a8-5f80-4109-b130-5fb96b8b34bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0d27a8-5f80-4109-b130-5fb96b8b34bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478268843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e0d2b8-695f-46f7-b1e9-33c01b462466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:29Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9834d6ea-855c-4150-bcbb-cf32e5d5dfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9834d6ea-855c-4150-bcbb-cf32e5d5dfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56b763f-04c7-48f9-9e7c-675af39a70fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56b763f-04c7-48f9-9e7c-675af39a70fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e0d2b8-695f-46f7-b1e9-33c01b462466', 'volume_name': 'volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c341c44e-298e-4bfd-838a-71cb9cae5ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c341c44e-298e-4bfd-838a-71cb9cae5ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4357bab1-6a6c-40a9-b040-34c2a27d0796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:29 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume c8e0d2b8-695f-46f7-b1e9-33c01b462466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466', 'volume_size': 1} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Acquiring lock "cinder-17007866-8f9a-47bd-8b5b-44de95acaad3-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Lock "cinder-17007866-8f9a-47bd-8b5b-44de95acaad3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Acquiring lock "cinder-quobyte-17007866-8f9a-47bd-8b5b-44de95acaad3" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Lock "cinder-quobyte-17007866-8f9a-47bd-8b5b-44de95acaad3" acquired by "delete_volume" :: waited 0.052s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:29 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (7ca24477-e1a0-46a8-90fa-9db1bb20d965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2dba62d-5b58-4e0c-916f-ede0dd34c71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218396a-0088-4d72-a6c6-e5fa99fd98e1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2dba62d-5b58-4e0c-916f-ede0dd34c71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053397640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58197c85-2534-44be-ad6c-d210ee130e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:30Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0552a30-1f9b-45f5-9779-e6c3c7d00728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0552a30-1f9b-45f5-9779-e6c3c7d00728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c86e9de-47a8-4804-89f5-a98e968c5d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c86e9de-47a8-4804-89f5-a98e968c5d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58197c85-2534-44be-ad6c-d210ee130e47', 'volume_name': 'volume-58197c85-2534-44be-ad6c-d210ee130e47', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276b664b-f99a-4bcb-b9e5-cf18c0860086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276b664b-f99a-4bcb-b9e5-cf18c0860086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6823c893-ac19-4faa-9c0d-66573418c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Volume 58197c85-2534-44be-ad6c-d210ee130e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58197c85-2534-44be-ad6c-d210ee130e47', 'volume_size': 1} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:30 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.026s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Deleted volume successfully. Jul 07 22:51:30 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 Jul 07 22:51:30 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-391d0ba7-dcbd-446d-8e53-238f8156fe2a tempest-CreateVolumesFromSourceVolumeTest-1289962577 None] Lock "cinder-e3f8d45c-7fb0-49d3-a0f4-a86a191617b3-delete_volume" released by "delete_volume" :: held 3.911s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:30 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 1073741824" returned: 0 in 1.361s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (b1b0d0a8-69d1-4f0a-b6e5-dd578f5cfa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25a29e5-714d-4ed9-974b-7ef92aa1f087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25a29e5-714d-4ed9-974b-7ef92aa1f087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1536078325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7513f0df-8a00-42f8-9259-8a7e9e1d3d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:30Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17ebfc2-bd29-4bd2-ad1d-fee81648e143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17ebfc2-bd29-4bd2-ad1d-fee81648e143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c705cc25-dd46-471d-9207-f28b68122e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c705cc25-dd46-471d-9207-f28b68122e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7513f0df-8a00-42f8-9259-8a7e9e1d3d60', 'volume_name': 'volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03fca78-cbf8-429a-a2da-e25da4b94f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03fca78-cbf8-429a-a2da-e25da4b94f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (face8d92-41e0-428a-9be3-ae657c3b420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume 7513f0df-8a00-42f8-9259-8a7e9e1d3d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60', 'volume_size': 1} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:30 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 Jul 07 22:51:30 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (9ee91085-26ee-4fe5-81dd-36a6499f3187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c32120-d310-41a6-9623-69bec547be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c32120-d310-41a6-9623-69bec547be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328803151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d609e5-8d06-4b55-945e-de627b1237de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:30Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc978a2-7a00-48ef-8699-6563b67748c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc978a2-7a00-48ef-8699-6563b67748c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa63910-fd59-41dd-8331-072bf9ebf3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa63910-fd59-41dd-8331-072bf9ebf3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d609e5-8d06-4b55-945e-de627b1237de', 'volume_name': 'volume-a6d609e5-8d06-4b55-945e-de627b1237de', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98bf13e-f681-4626-b3c6-49ec07672e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98bf13e-f681-4626-b3c6-49ec07672e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e0034b-894c-42c0-b19f-c92277927b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume a6d609e5-8d06-4b55-945e-de627b1237de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d609e5-8d06-4b55-945e-de627b1237de', 'volume_size': 1} Jul 07 22:51:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:31 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3" returned: 0 in 1.044s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:31 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3 Jul 07 22:51:31 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:31 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05" returned: 0 in 0.762s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.288s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.466s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2042625077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d047b5-ef6d-4163-8e9c-0daf99cff601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:28Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Creating volume f1d047b5-ef6d-4163-8e9c-0daf99cff601 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:31 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091bb5a8-89f7-40f6-975f-ccc00a7f299d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa039964-d00e-424b-8481-a03980e30d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:31 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 1073741824 Jul 07 22:51:31 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:31 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 (ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05): created successfully Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa039964-d00e-424b-8481-a03980e30d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (fe2a8c0e-8d5d-491f-8699-882b382c32f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:31 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-09255bdd-ce5a-4646-8438-efcbd3ccacc4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Created volume successfully. Jul 07 22:51:31 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-17007866-8f9a-47bd-8b5b-44de95acaad3" returned: 0 in 0.769s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Lock "cinder-quobyte-17007866-8f9a-47bd-8b5b-44de95acaad3" released by "delete_volume" :: held 1.908s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:31 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Created reservations ['5f668875-31a7-4b3b-8880-24ae055ec0d4', '7b2e8b21-b2a6-480f-8c91-06e67644cf21', '0f40ec0e-21ed-4781-8f29-b1dfe305fee8', '0a95aee1-c694-4d95-9276-cdce991fd90e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:32 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:32 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:32 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 1073741824" returned: 0 in 1.120s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:32 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 Jul 07 22:51:32 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Flow 'volume_create_manager' (bf9559b8-e7da-41b8-bfe3-217e0accf957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b836055-ef15-44ae-9b3b-7322094edaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:32 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b836055-ef15-44ae-9b3b-7322094edaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615646959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c029e53b-efa3-432e-8d91-7d3e4e48f996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e919fd70988451197328b64762fcebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:33Z,use_quota=True,user_id='4cd28c07874c4c9cb987b4ce768ebb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd86165c-2db8-4571-bc39-128d06178adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd86165c-2db8-4571-bc39-128d06178adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f862835e-ee37-41ed-9d06-678afc23ff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f862835e-ee37-41ed-9d06-678afc23ff48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c029e53b-efa3-432e-8d91-7d3e4e48f996', 'volume_name': 'volume-c029e53b-efa3-432e-8d91-7d3e4e48f996', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4181c0d-9caa-46ae-a801-5e2b55592be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4181c0d-9caa-46ae-a801-5e2b55592be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baa6b90-f27e-4a46-9cce-08caaeee6f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:32 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Volume c029e53b-efa3-432e-8d91-7d3e4e48f996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c029e53b-efa3-432e-8d91-7d3e4e48f996', 'volume_size': 1} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.886s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:32 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Deleted volume successfully. Jul 07 22:51:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d81a9f92-b37c-48cb-a010-f020281731dc tempest-ProjectReaderTests-669058302 None] Lock "cinder-17007866-8f9a-47bd-8b5b-44de95acaad3-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:33 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601" returned: 0 in 0.743s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.815s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478268843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e0d2b8-695f-46f7-b1e9-33c01b462466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:29Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Creating volume c8e0d2b8-695f-46f7-b1e9-33c01b462466 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:33 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:33 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 1073741824 Jul 07 22:51:33 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15bd7f4-e7e9-480b-9513-f9c01bd83e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf51726-adeb-4d2f-8a59-a048e113adc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:33 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 (f1d047b5-ef6d-4163-8e9c-0daf99cff601): created successfully Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf51726-adeb-4d2f-8a59-a048e113adc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (961d6ada-b5b1-4495-a359-6101b774e0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ab907ab3-202f-421e-bbbf-3c2d4ee17c1b tempest-CreateVolumesFromSnapshotTest-353593716 None] Created volume successfully. Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Flow 'volume_create_manager' (b1b2a438-2340-47f9-a5c4-72f7d4cd9a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bef843-0540-4d5b-82f1-1ff7880b389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bef843-0540-4d5b-82f1-1ff7880b389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88636494-cb04-48a5-b72e-f955aaf49721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7cfcd5a0e34796b81075d2ed42514f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:34Z,use_quota=True,user_id='546b027954444543b4ce9f8ff49508ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a116bb8d-6a37-4c9d-bbb1-ff87f89c8e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a116bb8d-6a37-4c9d-bbb1-ff87f89c8e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7973605-d86f-4cf8-b0ab-1c72f14f9ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7973605-d86f-4cf8-b0ab-1c72f14f9ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88636494-cb04-48a5-b72e-f955aaf49721', 'volume_name': 'volume-88636494-cb04-48a5-b72e-f955aaf49721', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58db5930-8693-453a-b899-ee6e10244e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58db5930-8693-453a-b899-ee6e10244e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6394a96-add0-4e0a-823e-65acec27477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:33 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Volume 88636494-cb04-48a5-b72e-f955aaf49721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88636494-cb04-48a5-b72e-f955aaf49721', 'volume_size': 1} Jul 07 22:51:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:34 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 1073741824" returned: 0 in 0.852s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:34 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 Jul 07 22:51:34 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:34 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466" returned: 0 in 0.662s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.636s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053397640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58197c85-2534-44be-ad6c-d210ee130e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:30Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Creating volume 58197c85-2534-44be-ad6c-d210ee130e47 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:34 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:34 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 1073741824 Jul 07 22:51:34 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4357bab1-6a6c-40a9-b040-34c2a27d0796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea99eb4-5649-446a-a960-eecdc9cbb3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:34 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 (c8e0d2b8-695f-46f7-b1e9-33c01b462466): created successfully Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea99eb4-5649-446a-a960-eecdc9cbb3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:34 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (278fc3bb-fbc3-4cb7-a3d2-20c655137760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-59f57ac9-f94e-4f91-82b4-3f2b923d68fe tempest-CreateVolumesFromSnapshotTest-353593716 None] Created volume successfully. Jul 07 22:51:35 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 1073741824" returned: 0 in 0.867s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:35 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 Jul 07 22:51:35 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:36 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47" returned: 0 in 0.710s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.915s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1536078325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7513f0df-8a00-42f8-9259-8a7e9e1d3d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:30Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Creating volume 7513f0df-8a00-42f8-9259-8a7e9e1d3d60 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:36 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6823c893-ac19-4faa-9c0d-66573418c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58197c85-2534-44be-ad6c-d210ee130e47', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:36 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 1073741824 Jul 07 22:51:36 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecc99b7-0932-4b75-98e4-8c10959e0216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:36 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Volume volume-58197c85-2534-44be-ad6c-d210ee130e47 (58197c85-2534-44be-ad6c-d210ee130e47): created successfully Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecc99b7-0932-4b75-98e4-8c10959e0216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:36 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (7ca24477-e1a0-46a8-90fa-9db1bb20d965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:36 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ce75fbb8-2e10-4f1f-92e4-ab1b21ce5966 tempest-ProjectReaderTests-1081494454 None] Created volume successfully. Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:37 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 1073741824" returned: 0 in 0.887s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:37 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 Jul 07 22:51:37 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:37 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60" returned: 0 in 0.617s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.344s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328803151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d609e5-8d06-4b55-945e-de627b1237de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a81138d164acca13f0965594ae74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:30Z,use_quota=True,user_id='5c54fcf6424a4e90ad632e80e3c95a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Creating volume a6d609e5-8d06-4b55-945e-de627b1237de {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:37 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:37 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de 1073741824 Jul 07 22:51:37 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (face8d92-41e0-428a-9be3-ae657c3b420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bb1702-91ad-438c-b1f2-0bf6365d7ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:37 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 (7513f0df-8a00-42f8-9259-8a7e9e1d3d60): created successfully Jul 07 22:51:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bb1702-91ad-438c-b1f2-0bf6365d7ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (b1b0d0a8-69d1-4f0a-b6e5-dd578f5cfa03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:38 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-fb38c20a-960e-4179-aa1c-caf025f7c9a1 tempest-CreateVolumesFromSnapshotTest-353593716 None] Created volume successfully. Jul 07 22:51:38 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de 1073741824" returned: 0 in 0.785s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:38 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de Jul 07 22:51:38 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:39 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de" returned: 0 in 0.637s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.488s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615646959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c029e53b-efa3-432e-8d91-7d3e4e48f996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e919fd70988451197328b64762fcebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:33Z,use_quota=True,user_id='4cd28c07874c4c9cb987b4ce768ebb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Creating volume c029e53b-efa3-432e-8d91-7d3e4e48f996 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:39 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e0034b-894c-42c0-b19f-c92277927b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d609e5-8d06-4b55-945e-de627b1237de', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:39 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 1073741824 Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1354cee6-5aa3-4cfd-90d5-2d76286088a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:39 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:39 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Volume volume-a6d609e5-8d06-4b55-945e-de627b1237de (a6d609e5-8d06-4b55-945e-de627b1237de): created successfully Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1354cee6-5aa3-4cfd-90d5-2d76286088a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:39 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Flow 'volume_create_manager' (9ee91085-26ee-4fe5-81dd-36a6499f3187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:39 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-737ab3e9-6440-4bb8-bba3-835e4fb95bf8 tempest-CreateVolumesFromSnapshotTest-353593716 None] Created volume successfully. Jul 07 22:51:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-a6d609e5-8d06-4b55-945e-de627b1237de-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-a6d609e5-8d06-4b55-945e-de627b1237de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-quobyte-a6d609e5-8d06-4b55-945e-de627b1237de" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:40 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-a6d609e5-8d06-4b55-945e-de627b1237de" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:40 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d90648-02ec-410d-90ce-f00b9253ab4b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:40 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de Jul 07 22:51:40 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:40 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 1073741824" returned: 0 in 0.947s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:40 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 Jul 07 22:51:40 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:41 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de" returned: 0 in 0.892s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:41 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996" returned: 0 in 0.686s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.252s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88636494-cb04-48a5-b72e-f955aaf49721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7cfcd5a0e34796b81075d2ed42514f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:34Z,use_quota=True,user_id='546b027954444543b4ce9f8ff49508ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Creating volume 88636494-cb04-48a5-b72e-f955aaf49721 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:41 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de Jul 07 22:51:41 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:41 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:41 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 1073741824 Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baa6b90-f27e-4a46-9cce-08caaeee6f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c029e53b-efa3-432e-8d91-7d3e4e48f996', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:41 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e27371-2c8c-406d-85e6-03a1d0094b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:41 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Volume volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 (c029e53b-efa3-432e-8d91-7d3e4e48f996): created successfully Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e27371-2c8c-406d-85e6-03a1d0094b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Flow 'volume_create_manager' (bf9559b8-e7da-41b8-bfe3-217e0accf957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:41 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-99b75122-bae6-491d-b07b-4684e8bfe12e tempest-ProjectReaderTests-669058302 None] Created volume successfully. Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Acquiring lock "cinder-c029e53b-efa3-432e-8d91-7d3e4e48f996-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Lock "cinder-c029e53b-efa3-432e-8d91-7d3e4e48f996-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Acquiring lock "cinder-quobyte-c029e53b-efa3-432e-8d91-7d3e4e48f996" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Lock "cinder-quobyte-c029e53b-efa3-432e-8d91-7d3e4e48f996" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dafb39b-d515-415c-9b73-208a9d29c3ff]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:41 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 Jul 07 22:51:41 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:41 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a6d609e5-8d06-4b55-945e-de627b1237de" returned: 0 in 0.771s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-a6d609e5-8d06-4b55-945e-de627b1237de" released by "delete_volume" :: held 1.714s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Created reservations ['2043eaa7-def0-45a7-bfee-a24a4f539a93', '752ed4b5-c83c-4222-8c54-4ac1c3d78727', '26354a28-ef2c-45d1-b8e6-4d7adb318b58', 'c5e5ac57-80aa-49ad-b50f-dcc1b36fafda'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:42 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:42 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:42 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 1073741824" returned: 0 in 0.956s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:42 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 Jul 07 22:51:42 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-7513f0df-8a00-42f8-9259-8a7e9e1d3d60-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:42 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996" returned: 0 in 0.897s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-7513f0df-8a00-42f8-9259-8a7e9e1d3d60-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:42 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996 Jul 07 22:51:42 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-quobyte-7513f0df-8a00-42f8-9259-8a7e9e1d3d60" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-7513f0df-8a00-42f8-9259-8a7e9e1d3d60" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25edcd5-7540-4f6d-a4b8-137e649107e6]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:42 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 Jul 07 22:51:42 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:42 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.797s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:42 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:42 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Deleted volume successfully. Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721" returned: 0 in 0.721s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.683s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a7b4fb59-4008-40f0-b579-2de17acb102a tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-a6d609e5-8d06-4b55-945e-de627b1237de-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Creating offline snapshot 7ebd47ac-3f88-4729-bf84-5f0b8f97b66b of volume 58197c85-2534-44be-ad6c-d210ee130e47 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6394a96-add0-4e0a-823e-65acec27477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88636494-cb04-48a5-b72e-f955aaf49721', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552ee13e-fa30-470a-b463-d4cf24fb19e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b79ba32-7cc7-4835-a9f4-ab8c378d6591]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:42 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Volume volume-88636494-cb04-48a5-b72e-f955aaf49721 (88636494-cb04-48a5-b72e-f955aaf49721): created successfully Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552ee13e-fa30-470a-b463-d4cf24fb19e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Flow 'volume_create_manager' (b1b2a438-2340-47f9-a5c4-72f7d4cd9a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:42 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7499c7c9-24b9-456b-b141-c4f77e02eeac tempest-CinderUnicodeTest-328987115 None] Created volume successfully. Jul 07 22:51:43 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 Jul 07 22:51:43 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:43 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c029e53b-efa3-432e-8d91-7d3e4e48f996" returned: 0 in 0.740s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Lock "cinder-quobyte-c029e53b-efa3-432e-8d91-7d3e4e48f996" released by "delete_volume" :: held 1.681s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Created reservations ['325c7f06-444e-4d76-a810-b68328a4da14', '1eb2b313-9418-4436-937c-f064c22b970e', '7edafd0d-3211-400e-88c2-9cdf1368b175', '167f33a5-8aa7-4cd3-81e8-364b27d80f7a'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:43 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:43 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:43 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60" returned: 0 in 0.895s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:43 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60 Jul 07 22:51:43 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:43 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47" returned: 0 in 1.049s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:43 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b 1G Jul 07 22:51:43 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Flow 'volume_create_manager' (2d4a3583-2036-4e70-a778-f8a955fd010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f791c5ad-ed7a-493e-8f2b-3a672b8f1919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f791c5ad-ed7a-493e-8f2b-3a672b8f1919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-112563460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a5a0a6-7966-4961-bbf6-e2319f7b35b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7cfcd5a0e34796b81075d2ed42514f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:44Z,use_quota=True,user_id='546b027954444543b4ce9f8ff49508ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d292928d-3548-4a1a-a153-38c674eba735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d292928d-3548-4a1a-a153-38c674eba735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f59ea7-27ec-4d0b-8030-364e9e136e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f59ea7-27ec-4d0b-8030-364e9e136e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a5a0a6-7966-4961-bbf6-e2319f7b35b3', 'volume_name': 'volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595b301c-0f3a-4625-b99d-4d5d8ce35a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595b301c-0f3a-4625-b99d-4d5d8ce35a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89cf25d5-385f-43fd-ae5e-9a345b606e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Volume e7a5a0a6-7966-4961-bbf6-e2319f7b35b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3', 'volume_size': 1} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Flow 'volume_create_manager' (59668e65-4cd3-4d9f-8d5d-662f682d2102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4eaf40e-be04-40dd-b7fe-f737b2ed13f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4eaf40e-be04-40dd-b7fe-f737b2ed13f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110999106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e919fd70988451197328b64762fcebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:44Z,use_quota=True,user_id='4cd28c07874c4c9cb987b4ce768ebb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59c3d71-34f8-477b-a635-7e95c0749b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59c3d71-34f8-477b-a635-7e95c0749b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f29b98-bc7c-478a-a8ab-e6008735a801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f29b98-bc7c-478a-a8ab-e6008735a801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c', 'volume_name': 'volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b96518-0b62-4b85-9757-a3dca59d4350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b96518-0b62-4b85-9757-a3dca59d4350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed34be0d-bf31-4a5e-9b57-e7f90a71ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:44 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Volume a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c', 'volume_size': 1} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:44 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:44 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.178s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7513f0df-8a00-42f8-9259-8a7e9e1d3d60" returned: 0 in 1.040s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:44 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Deleted volume successfully. Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-7513f0df-8a00-42f8-9259-8a7e9e1d3d60" released by "delete_volume" :: held 2.001s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de64f498-0d06-4b09-ba78-587eca1ef916 tempest-ProjectReaderTests-669058302 None] Lock "cinder-c029e53b-efa3-432e-8d91-7d3e4e48f996-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Created reservations ['58940c6b-4bed-41bd-972a-d2329c1a47b0', 'ff964c54-7996-4580-a65f-89dd8892aea5', '68d5216f-81b3-41b5-be41-d5ee89617ecf', '4e86eb54-481b-4063-a3a3-850559b07d1d'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:44 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:44 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:44 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b 1G" returned: 0 in 1.034s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58197c85-2534-44be-ad6c-d210ee130e47 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:44 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58197c85-2534-44be-ad6c-d210ee130e47 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b Jul 07 22:51:44 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:45 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.738s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Deleted volume successfully. Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-fb907d33-dd4c-4c16-9ed3-759aa1d2f014 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-7513f0df-8a00-42f8-9259-8a7e9e1d3d60-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:45 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58197c85-2534-44be-ad6c-d210ee130e47 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b" returned: 0 in 0.686s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:45 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b is being set with open permissions: ugo+rw Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:45 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b Jul 07 22:51:45 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-c8e0d2b8-695f-46f7-b1e9-33c01b462466-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-c8e0d2b8-695f-46f7-b1e9-33c01b462466-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-quobyte-c8e0d2b8-695f-46f7-b1e9-33c01b462466" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-c8e0d2b8-695f-46f7-b1e9-33c01b462466" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[373aa1ae-dd90-4edc-b81e-20db9455c88c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:45 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 Jul 07 22:51:45 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:46 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b" returned: 0 in 0.692s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:46 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.info Jul 07 22:51:46 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:46 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466" returned: 0 in 0.768s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:46 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466 Jul 07 22:51:46 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:47 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.info" returned: 0 in 0.788s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:47 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.info is being set with open permissions: ugo+rw Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:47 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.info Jul 07 22:51:47 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:47 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c8e0d2b8-695f-46f7-b1e9-33c01b462466" returned: 0 in 0.709s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-c8e0d2b8-695f-46f7-b1e9-33c01b462466" released by "delete_volume" :: held 1.524s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Created reservations ['bab81162-6281-4238-8585-0455a1ab9eee', 'c51484fa-ef08-4d49-83a1-915815356387', 'e2392a9d-8f7e-449f-b6ad-154e6078d74e', '3a9d81fe-fb74-4a9d-8d01-71f3efbd1e06'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:47 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:47 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-f1d047b5-ef6d-4163-8e9c-0daf99cff601-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:48 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.info" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.231s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-f1d047b5-ef6d-4163-8e9c-0daf99cff601-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.864s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-112563460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a5a0a6-7966-4961-bbf6-e2319f7b35b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7cfcd5a0e34796b81075d2ed42514f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:44Z,use_quota=True,user_id='546b027954444543b4ce9f8ff49508ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Creating volume e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:48 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:48 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 1073741824 Jul 07 22:51:48 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c5aa0795-0c54-406f-92bb-9078a10baf10 tempest-ProjectReaderTests-1081494454 None] Create snapshot completed successfully Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-quobyte-f1d047b5-ef6d-4163-8e9c-0daf99cff601" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-f1d047b5-ef6d-4163-8e9c-0daf99cff601" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a414642e-1c3a-48e8-969f-b5cdc1088c96]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:48 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.799s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:48 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Deleted volume successfully. Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5206032d-9b6d-4056-af48-b5d322f89383 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-c8e0d2b8-695f-46f7-b1e9-33c01b462466-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:48 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 Jul 07 22:51:48 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-7ebd47ac-3f88-4729-bf84-5f0b8f97b66b-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-7ebd47ac-3f88-4729-bf84-5f0b8f97b66b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-58197c85-2534-44be-ad6c-d210ee130e47" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-58197c85-2534-44be-ad6c-d210ee130e47" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-7ebd47ac-3f88-4729-bf84-5f0b8f97b66b" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-7ebd47ac-3f88-4729-bf84-5f0b8f97b66b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Deleting offline snapshot 7ebd47ac-3f88-4729-bf84-5f0b8f97b66b of volume 58197c85-2534-44be-ad6c-d210ee130e47 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] snapshot_file for this snap is: volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b7bef3-e1bf-43eb-a057-5ae9fd9d2c5b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:48 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b Jul 07 22:51:48 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:49 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 1073741824" returned: 0 in 0.972s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:49 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601" returned: 0 in 0.937s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:49 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 Jul 07 22:51:49 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:49 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601 Jul 07 22:51:49 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:49 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b" returned: 0 in 1.042s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58197c85-2534-44be-ad6c-d210ee130e47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:51:49 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f1d047b5-ef6d-4163-8e9c-0daf99cff601" returned: 0 in 0.713s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac92a07-7114-4e3b-b51e-56959a8d6416]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-f1d047b5-ef6d-4163-8e9c-0daf99cff601" released by "delete_volume" :: held 1.721s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:49 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" returned: 0 in 0.802s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.449s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110999106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e919fd70988451197328b64762fcebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:44Z,use_quota=True,user_id='4cd28c07874c4c9cb987b4ce768ebb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Creating volume a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:49 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:49 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c 1073741824 Jul 07 22:51:49 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89cf25d5-385f-43fd-ae5e-9a345b606e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e346150-9ed5-4613-9ce1-5c2fffe1e8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:50 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 Jul 07 22:51:50 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:50 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Volume volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 (e7a5a0a6-7966-4961-bbf6-e2319f7b35b3): created successfully Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e346150-9ed5-4613-9ce1-5c2fffe1e8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Flow 'volume_create_manager' (2d4a3583-2036-4e70-a778-f8a955fd010a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-072a2099-1a55-42b8-87f7-e566c516cbbd tempest-CinderUnicodeTest-328987115 None] Created volume successfully. Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Created reservations ['5589e159-707c-44a3-824c-5af14092168a', '4a884e8c-4926-4e1b-a254-415da0d03892', '2f4a0d2e-133f-407d-9fb5-01a225810aba', '6f555ad7-370d-4da2-887a-b79a1944988b'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:50 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:50 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-quobyte-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05" acquired by "delete_volume" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[890da89c-669a-4815-959e-66d50e4b51b7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:50 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 Jul 07 22:51:50 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:51 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47" returned: 0 in 1.116s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:51 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b Jul 07 22:51:51 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:51 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c 1073741824" returned: 0 in 1.212s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:51 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.040s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:51 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Deleted volume successfully. Jul 07 22:51:51 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c Jul 07 22:51:51 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6420511e-4336-4e95-91fa-f8d46798eeb0 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-f1d047b5-ef6d-4163-8e9c-0daf99cff601-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:51 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05" returned: 0 in 0.984s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:51 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05 Jul 07 22:51:51 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:51 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b" returned: 0 in 0.901s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:51 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b Jul 07 22:51:51 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:51 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c" returned: 0 in 0.745s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.126s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Creating offline snapshot 7bf22515-d99c-4d47-acd7-8ec0bc22b2cd of volume e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:51:51 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed34be0d-bf31-4a5e-9b57-e7f90a71ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801fed25-8269-4f06-8b6c-a4d98e6cd9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c6467-015f-445e-8e12-1cd4c70267b6]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:52 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Volume volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c (a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c): created successfully Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801fed25-8269-4f06-8b6c-a4d98e6cd9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Flow 'volume_create_manager' (59668e65-4cd3-4d9f-8d5d-662f682d2102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:52 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d9a3dcd6-ba5f-44a7-8d0a-3a35c631783c tempest-ProjectReaderTests-669058302 None] Created volume successfully. Jul 07 22:51:52 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 Jul 07 22:51:52 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:52 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05" returned: 0 in 0.756s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05" released by "delete_volume" :: held 1.797s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Created reservations ['34a2dfd0-c36b-4da6-84f8-945d35fe0840', '60eb483e-5032-4bb4-a33a-1087a29eaf16', 'fc2c4e1a-4f2b-4510-b953-33ffdf6c2bab', '2a344bfc-dcd6-4bd6-be77-20201eb5e4c4'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:52 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:52 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-80a5ed4f-6a22-4a45-9ce8-27a9d967674a-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-80a5ed4f-6a22-4a45-9ce8-27a9d967674a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-quobyte-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-quobyte-80a5ed4f-6a22-4a45-9ce8-27a9d967674a" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-80a5ed4f-6a22-4a45-9ce8-27a9d967674a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Deleting offline snapshot 80a5ed4f-6a22-4a45-9ce8-27a9d967674a of volume d04f2e42-c8e4-44b4-8c5f-5ee0633af28f {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] snapshot_file for this snap is: volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4554d32-512b-4514-a461-44fe76f3c132]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:52 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47.7ebd47ac-3f88-4729-bf84-5f0b8f97b66b" returned: 0 in 1.025s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-7ebd47ac-3f88-4729-bf84-5f0b8f97b66b" released by "_delete_snapshot" :: held 4.228s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-58197c85-2534-44be-ad6c-d210ee130e47" released by "delete_snapshot" :: held 4.260s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:53 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a Jul 07 22:51:53 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:53 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Acquiring lock "cinder-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" returned: 0 in 1.114s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Created reservations ['1418e274-7421-46fa-b702-242b799ab8bc', '15006894-e3d3-43cf-a162-2dbd9d11717f', '3d58e291-97a2-4111-ba93-ec172f6faf49', 'eb3afb42-59d4-4fbb-810d-e0b439b2c4dd'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Lock "cinder-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:53 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd 1G Jul 07 22:51:53 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Acquiring lock "cinder-quobyte-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:53 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Lock "cinder-quobyte-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.824s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Deleted volume successfully. Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[197cfe1a-c4d4-41da-be03-b89906c791a7]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Delete snapshot completed successfully. Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d7f0cb4f-8297-4c7d-a014-40fbb64cd170 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-7ebd47ac-3f88-4729-bf84-5f0b8f97b66b-delete_snapshot" released by "delete_snapshot" :: held 4.610s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-87719c99-d02f-4081-bf86-774f3df2aa33 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-ebb9b0db-58e1-4f6a-99d7-86ffd8d85c05-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:53 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c Jul 07 22:51:53 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:53 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a" returned: 0 in 1.103s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6caa809-96c7-48ef-8541-4aceb1e48730]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-58197c85-2534-44be-ad6c-d210ee130e47-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Lock "cinder-58197c85-2534-44be-ad6c-d210ee130e47-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-58197c85-2534-44be-ad6c-d210ee130e47" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:54 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f Jul 07 22:51:54 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-58197c85-2534-44be-ad6c-d210ee130e47" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:54 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c" returned: 0 in 0.883s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:54 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd 1G" returned: 0 in 1.065s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:54 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c Jul 07 22:51:54 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b3d193-ac01-4a76-a2f6-7e75f2e13a0d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:54 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd Jul 07 22:51:54 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:54 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 Jul 07 22:51:54 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:54 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:54 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a Jul 07 22:51:54 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:54 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c" returned: 0 in 0.813s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:55 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47" returned: 0 in 0.795s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Lock "cinder-quobyte-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c" released by "delete_volume" :: held 1.770s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:55 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47 Jul 07 22:51:55 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:55 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Created reservations ['44b6019d-bbc5-4aa3-8e38-8646c0d6073a', 'f187642f-613c-4660-b365-4c2a2e0d7650', '780d8f41-39f2-4e0c-bd12-6d2f756aa2d0', '0e512d98-1074-4820-9af0-b9b3cecee6f2'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd" returned: 0 in 0.887s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:55 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd is being set with open permissions: ugo+rw Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:55 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd Jul 07 22:51:55 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:55 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:55 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:55 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-58197c85-2534-44be-ad6c-d210ee130e47" returned: 0 in 0.762s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-58197c85-2534-44be-ad6c-d210ee130e47" released by "delete_volume" :: held 1.654s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:55 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd" returned: 0 in 0.816s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:55 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:55 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:55 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a" returned: 0 in 1.072s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:55 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Created reservations ['db54efc0-b53e-4c9e-83ad-63dccedef17d', 'ec966bb9-5a02-472b-b51e-8b2adfbaeef1', 'ef6eae6e-75d8-429f-aba9-1b25a4196595', 'a4554378-1864-414a-b686-abb0f9c84b61'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:55 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a Jul 07 22:51:55 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:56 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.info Jul 07 22:51:56 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:56 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.885s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:56 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Deleted volume successfully. Jul 07 22:51:56 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:51:56 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1898adaa-4b2d-4aad-9acb-38d6828068fb tempest-ProjectReaderTests-669058302 None] Lock "cinder-a56bfac3-0f5f-4d6c-8b63-a43a8cc7c25c-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:57 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.info" returned: 0 in 1.079s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:57 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.info is being set with open permissions: ugo+rw Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:57 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.278s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:51:57 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.info Jul 07 22:51:57 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (2420008b-6d9d-4a9c-9ea5-66db15cf88af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f420881-9e62-48d7-b2b1-0e2f5182a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f420881-9e62-48d7-b2b1-0e2f5182a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-735404822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054cb111-0ed7-48f9-9569-6a836ecad26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:57Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335c4149-3df0-48de-92a5-777a691398e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335c4149-3df0-48de-92a5-777a691398e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c2fafc-fdf3-43c6-8f2e-7c7009e07e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c2fafc-fdf3-43c6-8f2e-7c7009e07e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054cb111-0ed7-48f9-9569-6a836ecad26d', 'volume_name': 'volume-054cb111-0ed7-48f9-9569-6a836ecad26d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78049efa-f241-4bd8-a3c9-0fae080c0299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78049efa-f241-4bd8-a3c9-0fae080c0299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81d9ac1-f96c-4267-830a-b70281338dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:57 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Volume 054cb111-0ed7-48f9-9569-6a836ecad26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054cb111-0ed7-48f9-9569-6a836ecad26d', 'volume_size': 1} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:57 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f.80a5ed4f-6a22-4a45-9ce8-27a9d967674a" returned: 0 in 1.335s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-80a5ed4f-6a22-4a45-9ce8-27a9d967674a" released by "_delete_snapshot" :: held 4.521s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" released by "delete_snapshot" :: held 4.556s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Created reservations ['d38e98b0-5044-4296-b486-84c2b99cf36c', 'fc1d7d53-5179-44bd-a64f-be85b04bef18', 'b505bed2-53d5-4a32-aa07-aa428b382f7f', '7a62c0e3-52d5-4b74-9dfc-4b002dfd592d'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:51:57 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:57 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Delete snapshot completed successfully. Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.446s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4826fae9-db77-4d75-b222-8645842763f4 tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-80a5ed4f-6a22-4a45-9ce8-27a9d967674a-delete_snapshot" released by "delete_snapshot" :: held 4.816s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:57 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Deleted volume successfully. Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-027b7c0c-88ee-4a4d-ac33-80463a4404bb tempest-ProjectReaderTests-1081494454 None] Lock "cinder-58197c85-2534-44be-ad6c-d210ee130e47-delete_volume" released by "delete_volume" :: held 3.499s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:51:57 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.info" returned: 0 in 0.871s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.046s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-735404822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054cb111-0ed7-48f9-9569-6a836ecad26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:57Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Creating volume 054cb111-0ed7-48f9-9569-6a836ecad26d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:51:58 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:58 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d 1073741824 Jul 07 22:51:58 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e1e5af84-d6c9-4313-b119-1f6494ab4385 tempest-CinderUnicodeTest-328987115 None] Create snapshot completed successfully Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "cinder-quobyte-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6556ca-7198-4d0f-82df-ea187238d679]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Acquiring lock "cinder-7bf22515-d99c-4d47-acd7-8ec0bc22b2cd-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Lock "cinder-7bf22515-d99c-4d47-acd7-8ec0bc22b2cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Acquiring lock "cinder-quobyte-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Lock "cinder-quobyte-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Acquiring lock "cinder-quobyte-7bf22515-d99c-4d47-acd7-8ec0bc22b2cd" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Lock "cinder-quobyte-7bf22515-d99c-4d47-acd7-8ec0bc22b2cd" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:51:58 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Deleting offline snapshot 7bf22515-d99c-4d47-acd7-8ec0bc22b2cd of volume e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:51:58 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] snapshot_file for this snap is: volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a948ae64-c78f-42f8-8ad9-052c91bb33a3]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:58 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd Jul 07 22:51:58 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:59 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d 1073741824" returned: 0 in 1.117s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:59 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d Jul 07 22:51:59 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:59 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" returned: 0 in 0.890s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:59 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f Jul 07 22:51:59 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:59 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd" returned: 0 in 0.881s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eb4639-0948-4330-9f1d-1f6c0f247a7e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:51:59 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 Jul 07 22:51:59 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:51:59 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d" returned: 0 in 0.666s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81d9ac1-f96c-4267-830a-b70281338dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054cb111-0ed7-48f9-9569-6a836ecad26d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab34e00c-ce4a-4a91-bfe9-96633557bef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:51:59 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Volume volume-054cb111-0ed7-48f9-9569-6a836ecad26d (054cb111-0ed7-48f9-9569-6a836ecad26d): created successfully Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab34e00c-ce4a-4a91-bfe9-96633557bef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (2420008b-6d9d-4a9c-9ea5-66db15cf88af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:51:59 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9b6ec99a-9427-404f-ad13-d271bc7af2dd tempest-ProjectReaderTests-1081494454 None] Created volume successfully. Jul 07 22:51:59 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 07 22:51:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" returned: 0 in 0.740s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-quobyte-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f" released by "delete_volume" :: held 1.723s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Created reservations ['22da9ec8-a360-4e60-bb56-c79359b179ad', 'e48b711c-cf78-4288-9d37-68885194813c', '4f80eb57-7437-4d98-b9ef-7cae58bc002e', '6d864dbc-76fc-4d27-bd89-e96656273112'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:00 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:00 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:00 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" returned: 0 in 0.926s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:00 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd Jul 07 22:52:00 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Creating offline snapshot 13e81ca7-f342-4d38-8ea1-e70857dac5a8 of volume 054cb111-0ed7-48f9-9569-6a836ecad26d {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d8e7e-73c9-4379-a24c-1d3ccabde328]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:00 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d Jul 07 22:52:00 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:00 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.808s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:00 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Deleted volume successfully. Jul 07 22:52:01 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9899e044-f14a-46bd-b9e6-26c6ea75c6fc tempest-CreateVolumesFromSnapshotTest-353593716 None] Lock "cinder-d04f2e42-c8e4-44b4-8c5f-5ee0633af28f-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:01 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd" returned: 0 in 0.900s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:01 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd Jul 07 22:52:01 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:01 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d" returned: 0 in 1.048s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:01 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 1G Jul 07 22:52:01 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:02 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3.7bf22515-d99c-4d47-acd7-8ec0bc22b2cd" returned: 0 in 0.813s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Lock "cinder-quobyte-7bf22515-d99c-4d47-acd7-8ec0bc22b2cd" released by "_delete_snapshot" :: held 3.656s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Lock "cinder-quobyte-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" released by "delete_snapshot" :: held 3.699s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Created reservations ['5a292751-178e-4db1-9288-43b7c0fd5a6e', '4b0ec6e2-dd3a-4172-83d5-9412c5afb04e', '9a9d0df1-45ba-41b1-9d94-035ff5604dda', '3202c902-6203-48a1-ab2f-098f613e8823'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:02 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Delete snapshot completed successfully. Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c8b6fca-4613-4589-a6c1-921f6dd7ed9b tempest-CinderUnicodeTest-328987115 None] Lock "cinder-7bf22515-d99c-4d47-acd7-8ec0bc22b2cd-delete_snapshot" released by "delete_snapshot" :: held 3.864s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:02 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 1G" returned: 0 in 0.924s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054cb111-0ed7-48f9-9569-6a836ecad26d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:02 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054cb111-0ed7-48f9-9569-6a836ecad26d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 Jul 07 22:52:02 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Acquiring lock "cinder-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Lock "cinder-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Acquiring lock "cinder-quobyte-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Lock "cinder-quobyte-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6aef84-86bb-4809-b9ad-43a96860887e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:03 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 Jul 07 22:52:03 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:03 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054cb111-0ed7-48f9-9569-6a836ecad26d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8" returned: 0 in 0.920s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:03 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 is being set with open permissions: ugo+rw Jul 07 22:52:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:03 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 Jul 07 22:52:03 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:03 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" returned: 0 in 0.867s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:03 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3 Jul 07 22:52:03 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Flow 'volume_create_manager' (088bfe2a-e124-448e-8a77-a2b082809c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5679af-4f33-42cb-8a05-eea0ce114a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:04 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5679af-4f33-42cb-8a05-eea0ce114a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-152235695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a77120e-702f-4c10-88ee-69fc8dae74a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f133ae60ce4dd4a1e0fe98bcf0ad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:04Z,use_quota=True,user_id='398dbb795ae54ed183d9b13c17ca6a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4905e6f5-b69c-4cba-80ee-4cf817fff540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4905e6f5-b69c-4cba-80ee-4cf817fff540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678effc5-f0a4-4b35-8dbb-82ad6867d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678effc5-f0a4-4b35-8dbb-82ad6867d97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a77120e-702f-4c10-88ee-69fc8dae74a8', 'volume_name': 'volume-2a77120e-702f-4c10-88ee-69fc8dae74a8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97cba13-255b-4add-888b-12c586420974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97cba13-255b-4add-888b-12c586420974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a35a6c-2ef3-4c6a-b910-9861beac0578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:04 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Volume 2a77120e-702f-4c10-88ee-69fc8dae74a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a77120e-702f-4c10-88ee-69fc8dae74a8', 'volume_size': 1} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8" returned: 0 in 0.796s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:04 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.info Jul 07 22:52:04 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:04 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" returned: 0 in 0.868s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Lock "cinder-quobyte-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3" released by "delete_volume" :: held 1.809s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Created reservations ['eac111fa-27f3-4d72-bb3f-34c51cc0e2e3', 'b8e48775-a43d-412a-9980-62c439133948', '71052198-d5e1-43f4-a1cf-f1162003991b', '1ffc79ba-108a-44c7-a465-632afc9c45ca'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:04 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:04 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Acquiring lock "cinder-88636494-cb04-48a5-b72e-f955aaf49721-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:05 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.info" returned: 0 in 0.727s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:05 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.info is being set with open permissions: ugo+rw Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Lock "cinder-88636494-cb04-48a5-b72e-f955aaf49721-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:05 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.info Jul 07 22:52:05 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Acquiring lock "cinder-quobyte-88636494-cb04-48a5-b72e-f955aaf49721" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Lock "cinder-quobyte-88636494-cb04-48a5-b72e-f955aaf49721" acquired by "delete_volume" :: waited 0.031s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e45aed-49d9-49f9-80ef-46e236768f30]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:05 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 Jul 07 22:52:05 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:05 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.748s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Deleted volume successfully. Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-1ddc8acf-61b1-41f5-9735-850c5840ac42 tempest-CinderUnicodeTest-328987115 None] Lock "cinder-e7a5a0a6-7966-4961-bbf6-e2319f7b35b3-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:05 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.info" returned: 0 in 0.801s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.332s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-152235695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a77120e-702f-4c10-88ee-69fc8dae74a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f133ae60ce4dd4a1e0fe98bcf0ad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:04Z,use_quota=True,user_id='398dbb795ae54ed183d9b13c17ca6a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Creating volume 2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:05 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:52:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:05 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 1073741824 Jul 07 22:52:05 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:05 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-951108be-a039-4ed1-917d-58f36577eabc tempest-ProjectReaderTests-1081494454 None] Create snapshot completed successfully Jul 07 22:52:06 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721" returned: 0 in 0.840s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:06 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721 Jul 07 22:52:06 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:06 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 1073741824" returned: 0 in 0.859s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:06 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-88636494-cb04-48a5-b72e-f955aaf49721" returned: 0 in 0.761s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-13e81ca7-f342-4d38-8ea1-e70857dac5a8-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:06 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 Jul 07 22:52:06 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Lock "cinder-quobyte-88636494-cb04-48a5-b72e-f955aaf49721" released by "delete_volume" :: held 1.670s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Lock "cinder-13e81ca7-f342-4d38-8ea1-e70857dac5a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-054cb111-0ed7-48f9-9569-6a836ecad26d" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-054cb111-0ed7-48f9-9569-6a836ecad26d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-13e81ca7-f342-4d38-8ea1-e70857dac5a8" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-13e81ca7-f342-4d38-8ea1-e70857dac5a8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Deleting offline snapshot 13e81ca7-f342-4d38-8ea1-e70857dac5a8 of volume 054cb111-0ed7-48f9-9569-6a836ecad26d {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] snapshot_file for this snap is: volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac38a6f-f2ce-4e5f-894f-ee5c45a8454d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:06 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Created reservations ['b9e52c57-691e-4d79-8a80-ef4b676b8c86', '9d34a753-94b4-4ce5-aeae-8989c852d8ef', '3f98ec4e-2627-4f60-98a4-e9b148f161d9', '6ffabf15-2362-4316-ba99-4189403a8b07'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:07 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 Jul 07 22:52:07 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:07 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:07 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:07 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8" returned: 0 in 0.774s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a35a6c-2ef3-4c6a-b910-9861beac0578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a77120e-702f-4c10-88ee-69fc8dae74a8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c5e879-0254-4aeb-acc2-0ad4eb73bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Volume volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 (2a77120e-702f-4c10-88ee-69fc8dae74a8): created successfully Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c5e879-0254-4aeb-acc2-0ad4eb73bcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Flow 'volume_create_manager' (088bfe2a-e124-448e-8a77-a2b082809c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a1f0db7d-b256-4448-86e1-034cf4adbcdb tempest-VolumeDependencyTests-1434132078 None] Created volume successfully. Jul 07 22:52:07 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8" returned: 0 in 0.960s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-054cb111-0ed7-48f9-9569-6a836ecad26d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:52:07 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.878s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51a968-08a0-4b2b-acbb-0a9893451cde]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Deleted volume successfully. Jul 07 22:52:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-3937a4d0-6255-4260-bc4e-a823da72501e tempest-CinderUnicodeTest-328987115 None] Lock "cinder-88636494-cb04-48a5-b72e-f955aaf49721-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:08 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d Jul 07 22:52:08 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Creating offline snapshot 3626ddd3-98dc-43e6-b968-64b1acffd468 of volume 2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:52:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86f41a2-27e1-4197-a429-1b1f3e5c0a2a]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:08 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d" returned: 0 in 0.954s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:08 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 Jul 07 22:52:08 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:08 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 Jul 07 22:52:08 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:09 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8" returned: 0 in 0.848s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:09 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 1G Jul 07 22:52:09 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:09 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8" returned: 0 in 0.952s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:09 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8 Jul 07 22:52:09 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:10 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d.13e81ca7-f342-4d38-8ea1-e70857dac5a8" returned: 0 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-13e81ca7-f342-4d38-8ea1-e70857dac5a8" released by "_delete_snapshot" :: held 3.771s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-054cb111-0ed7-48f9-9569-6a836ecad26d" released by "delete_snapshot" :: held 3.802s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:10 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 1G" returned: 0 in 1.072s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:10 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 Jul 07 22:52:10 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:10 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Created reservations ['b69dd63c-200d-445f-8645-0cf7c58097e2', 'bfd846a6-c599-49f0-b99c-5d3be79f90ef', 'cca85336-312f-4d96-9b3c-485c60a4227e', 'ca750b31-97b1-42e0-aa18-9e4711d1469b'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:10 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Delete snapshot completed successfully. Jul 07 22:52:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b62bb7c4-c070-40c8-8e2e-54079b7db80b tempest-ProjectReaderTests-1081494454 None] Lock "cinder-13e81ca7-f342-4d38-8ea1-e70857dac5a8-delete_snapshot" released by "delete_snapshot" :: held 4.008s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-054cb111-0ed7-48f9-9569-6a836ecad26d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-054cb111-0ed7-48f9-9569-6a836ecad26d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-054cb111-0ed7-48f9-9569-6a836ecad26d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-054cb111-0ed7-48f9-9569-6a836ecad26d" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:11 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[90100b1d-f89c-44fe-95fa-89991b365475]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:11 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d Jul 07 22:52:11 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:11 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468" returned: 0 in 0.901s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:11 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 is being set with open permissions: ugo+rw Jul 07 22:52:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:11 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 Jul 07 22:52:11 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:12 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d" returned: 0 in 0.935s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:12 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d Jul 07 22:52:12 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:12 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468" returned: 0 in 0.659s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:12 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.info Jul 07 22:52:12 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:13 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.info" returned: 0 in 0.681s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:13 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.info is being set with open permissions: ugo+rw Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:13 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-054cb111-0ed7-48f9-9569-6a836ecad26d" returned: 0 in 0.798s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:13 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.info Jul 07 22:52:13 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-054cb111-0ed7-48f9-9569-6a836ecad26d" released by "delete_volume" :: held 1.816s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Created reservations ['0906c01b-4cd3-4dee-9978-d1c804274923', '7d486b99-8b51-421a-b173-313156aa45df', '8fffd280-ff4a-4bc7-bff8-b5cb325061c1', '78e36138-40d5-4846-b925-45ac0b95d4cc'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:13 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:13 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:13 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.info" returned: 0 in 0.954s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.235s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:14 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.761s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Deleted volume successfully. Jul 07 22:52:14 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e3afe344-ed0c-4dfb-a069-631d2a0f823c tempest-VolumeDependencyTests-1434132078 None] Create snapshot completed successfully Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-84c5bf51-71f5-4494-9e8f-7967db538530 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-054cb111-0ed7-48f9-9569-6a836ecad26d-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (0bd7501b-6def-4617-9875-f4a21df1fdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38afc73-0fe5-4b8b-af2f-f9a8e9ec0273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38afc73-0fe5-4b8b-af2f-f9a8e9ec0273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600217918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222fa0b4-0045-41d5-ba31-6272029b8858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:14Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc0c64a-659c-44a5-9318-fd13007b6a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc0c64a-659c-44a5-9318-fd13007b6a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a014f14-0a64-49e3-8ef5-82a29a074c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a014f14-0a64-49e3-8ef5-82a29a074c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222fa0b4-0045-41d5-ba31-6272029b8858', 'volume_name': 'volume-222fa0b4-0045-41d5-ba31-6272029b8858', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f09fb17-61d5-478b-86db-94593c428b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f09fb17-61d5-478b-86db-94593c428b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5ec9c8-69aa-47de-be1c-245940827293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:14 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Volume 222fa0b4-0045-41d5-ba31-6272029b8858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222fa0b4-0045-41d5-ba31-6272029b8858', 'volume_size': 1} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600217918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222fa0b4-0045-41d5-ba31-6272029b8858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:14Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Creating volume 222fa0b4-0045-41d5-ba31-6272029b8858 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:14 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:52:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:14 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 1073741824 Jul 07 22:52:14 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:15 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 1073741824" returned: 0 in 0.877s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:15 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 Jul 07 22:52:15 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Flow 'volume_create_manager' (f0556735-d7f1-458a-ba53-f4280bc2833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a79b4f-9f63-4133-a862-2870c58fcefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a79b4f-9f63-4133-a862-2870c58fcefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1754996030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6ffdea-3668-4ca5-8be5-a6343794de20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f133ae60ce4dd4a1e0fe98bcf0ad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3626ddd3-98dc-43e6-b968-64b1acffd468,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:16Z,use_quota=True,user_id='398dbb795ae54ed183d9b13c17ca6a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13419c11-6136-482a-b1c4-c6790a37a3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13419c11-6136-482a-b1c4-c6790a37a3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ecd4e3-ec63-4a35-9a6f-ebf2881286ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ecd4e3-ec63-4a35-9a6f-ebf2881286ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af6ffdea-3668-4ca5-8be5-a6343794de20', 'volume_name': 'volume-af6ffdea-3668-4ca5-8be5-a6343794de20', 'volume_size': 1, 'snapshot_id': '3626ddd3-98dc-43e6-b968-64b1acffd468'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbebc43-8c82-4f6f-916b-31b451ade8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbebc43-8c82-4f6f-916b-31b451ade8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc652cc9-5f47-48bd-a546-a1615fd41e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Volume af6ffdea-3668-4ca5-8be5-a6343794de20: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af6ffdea-3668-4ca5-8be5-a6343794de20', 'volume_size': 1, 'snapshot_id': '3626ddd3-98dc-43e6-b968-64b1acffd468'} Jul 07 22:52:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:16 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858" returned: 0 in 0.738s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.169s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-quobyte-3626ddd3-98dc-43e6-b968-64b1acffd468-af6ffdea-3668-4ca5-8be5-a6343794de20" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5ec9c8-69aa-47de-be1c-245940827293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222fa0b4-0045-41d5-ba31-6272029b8858', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954979b4-93b4-4f35-9c97-5a49c545154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-3626ddd3-98dc-43e6-b968-64b1acffd468-af6ffdea-3668-4ca5-8be5-a6343794de20" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Creating volume af6ffdea-3668-4ca5-8be5-a6343794de20 from snapshot 3626ddd3-98dc-43e6-b968-64b1acffd468 {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-quobyte-af6ffdea-3668-4ca5-8be5-a6343794de20" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:16 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Volume volume-222fa0b4-0045-41d5-ba31-6272029b8858 (222fa0b4-0045-41d5-ba31-6272029b8858): created successfully Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954979b4-93b4-4f35-9c97-5a49c545154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (0bd7501b-6def-4617-9875-f4a21df1fdf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-af6ffdea-3668-4ca5-8be5-a6343794de20" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] snapshot: 3626ddd3-98dc-43e6-b968-64b1acffd468, volume: af6ffdea-3668-4ca5-8be5-a6343794de20, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:52:16 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-04c80b6f-f755-4e70-8afb-a04b4d3dbf5b tempest-ProjectReaderTests-1081494454 None] Created volume successfully. Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad9c084-d34a-4007-825b-21bb490e8979]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:16 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 Jul 07 22:52:16 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:17 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468" returned: 0 in 0.863s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a77120e-702f-4c10-88ee-69fc8dae74a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aff1680-577d-40bd-8de6-271c4955a005]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:17 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 Jul 07 22:52:17 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:17 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8" returned: 0 in 0.890s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:52:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:17 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 Jul 07 22:52:17 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:23 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20" returned: 0 in 5.094s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e25942-eb87-4459-98ea-d975fa0e999d]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:23 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 Jul 07 22:52:23 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:24 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8" returned: 0 in 0.964s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:52:24 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Converted 1024.00 MB image at 200.97 MB/s Jul 07 22:52:24 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 is being set with open permissions: ugo+rw Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:24 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 Jul 07 22:52:24 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:24 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20" returned: 0 in 0.661s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-af6ffdea-3668-4ca5-8be5-a6343794de20" released by "_copy_volume_from_snapshot" :: held 8.592s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-3626ddd3-98dc-43e6-b968-64b1acffd468-af6ffdea-3668-4ca5-8be5-a6343794de20" released by "_create_volume_from_snapshot" :: held 8.637s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.672s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.309s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:INSERT=57,cinder:UPDATE=243,cinder:DELETE=21,cinder:SELECT=164 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=170,cinder:UPDATE=229,cinder:DELETE=20,cinder:INSERT=62 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Creating offline snapshot d51c948e-8437-4b8e-9171-58e5e002bd49 of volume 222fa0b4-0045-41d5-ba31-6272029b8858 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c66ea6f-b655-4cd0-a267-e4b453c145e5]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc652cc9-5f47-48bd-a546-a1615fd41e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6ffdea-3668-4ca5-8be5-a6343794de20', 'volume_size': 1, 'snapshot_id': '3626ddd3-98dc-43e6-b968-64b1acffd468'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a37c56-8a13-465b-8448-db9d188b95db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:24 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Volume volume-af6ffdea-3668-4ca5-8be5-a6343794de20 (af6ffdea-3668-4ca5-8be5-a6343794de20): created successfully Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a37c56-8a13-465b-8448-db9d188b95db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:24 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Flow 'volume_create_manager' (f0556735-d7f1-458a-ba53-f4280bc2833d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:24 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e68deaaa-d969-4259-ac1f-5512a72486f5 tempest-VolumeDependencyTests-1434132078 None] Created volume successfully. Jul 07 22:52:24 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 Jul 07 22:52:24 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-3626ddd3-98dc-43e6-b968-64b1acffd468-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-3626ddd3-98dc-43e6-b968-64b1acffd468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-quobyte-2a77120e-702f-4c10-88ee-69fc8dae74a8" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-2a77120e-702f-4c10-88ee-69fc8dae74a8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-quobyte-3626ddd3-98dc-43e6-b968-64b1acffd468" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-3626ddd3-98dc-43e6-b968-64b1acffd468" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Deleting offline snapshot 3626ddd3-98dc-43e6-b968-64b1acffd468 of volume 2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] snapshot_file for this snap is: volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a180d64b-b504-491f-939d-b3015664d5cc]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:25 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858" returned: 0 in 0.836s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:25 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 1G Jul 07 22:52:25 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:25 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 Jul 07 22:52:25 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:26 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468" returned: 0 in 0.859s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a77120e-702f-4c10-88ee-69fc8dae74a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:52:26 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbaf437-2107-4ffb-aba1-b3af7aed0860]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:26 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 1G" returned: 0 in 0.861s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222fa0b4-0045-41d5-ba31-6272029b8858 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:26 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222fa0b4-0045-41d5-ba31-6272029b8858 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 Jul 07 22:52:26 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:26 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 Jul 07 22:52:26 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:27 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222fa0b4-0045-41d5-ba31-6272029b8858 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49" returned: 0 in 0.773s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:27 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 is being set with open permissions: ugo+rw Jul 07 22:52:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:27 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 Jul 07 22:52:27 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:27 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8" returned: 0 in 0.861s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:27 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 Jul 07 22:52:27 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:27 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49" returned: 0 in 0.710s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:28 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.info Jul 07 22:52:28 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:28 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468" returned: 0 in 0.872s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:28 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468 Jul 07 22:52:28 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:28 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.info" returned: 0 in 0.834s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:28 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.info is being set with open permissions: ugo+rw Jul 07 22:52:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:28 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8.3626ddd3-98dc-43e6-b968-64b1acffd468" returned: 0 in 0.694s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:28 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.info Jul 07 22:52:28 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-3626ddd3-98dc-43e6-b968-64b1acffd468" released by "_delete_snapshot" :: held 3.409s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:28 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-2a77120e-702f-4c10-88ee-69fc8dae74a8" released by "delete_snapshot" :: held 3.435s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:28 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Created reservations ['bd93f8bc-59e2-4dea-8c41-6147969cb171', 'aa599f3e-9b84-4138-a8a2-8e6e6d53b0d8', 'b01da648-df66-4a00-bb60-0ed6e357fe05', '674846b3-f24e-4439-9949-17b9541b88c9'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Delete snapshot completed successfully. Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-397b4489-97f9-43e9-baad-cdca054a81be tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-3626ddd3-98dc-43e6-b968-64b1acffd468-delete_snapshot" released by "delete_snapshot" :: held 3.620s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:29 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.info" returned: 0 in 0.708s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.830s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:29 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3a26cb82-5a18-4793-9548-0ac894ffe008 tempest-ProjectReaderTests-1081494454 None] Create snapshot completed successfully Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-2a77120e-702f-4c10-88ee-69fc8dae74a8-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-2a77120e-702f-4c10-88ee-69fc8dae74a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-quobyte-2a77120e-702f-4c10-88ee-69fc8dae74a8" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-2a77120e-702f-4c10-88ee-69fc8dae74a8" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[11544177-c73c-4f8e-ab0d-9d4d9c73463f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:29 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 Jul 07 22:52:29 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-d51c948e-8437-4b8e-9171-58e5e002bd49-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-d51c948e-8437-4b8e-9171-58e5e002bd49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-222fa0b4-0045-41d5-ba31-6272029b8858" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-222fa0b4-0045-41d5-ba31-6272029b8858" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-d51c948e-8437-4b8e-9171-58e5e002bd49" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-d51c948e-8437-4b8e-9171-58e5e002bd49" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Deleting offline snapshot d51c948e-8437-4b8e-9171-58e5e002bd49 of volume 222fa0b4-0045-41d5-ba31-6272029b8858 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] snapshot_file for this snap is: volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e3148-502b-4261-8023-099e67818a06]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:30 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 Jul 07 22:52:30 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:30 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8" returned: 0 in 0.878s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:30 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8 Jul 07 22:52:30 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:30 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-222fa0b4-0045-41d5-ba31-6272029b8858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f90b12-a90b-4da4-aaea-7dcb33f11869]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:31 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 Jul 07 22:52:31 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:31 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-2a77120e-702f-4c10-88ee-69fc8dae74a8" returned: 0 in 0.727s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-2a77120e-702f-4c10-88ee-69fc8dae74a8" released by "delete_volume" :: held 1.664s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Created reservations ['8ae14167-f7f3-482f-9682-b005dbced560', '4a36b04f-a275-4ff3-89b3-d588b25a8f26', 'dcf74bf4-9de5-4fb7-8c15-bdde4452de1e', 'a753f898-0680-433a-8505-65621781b86e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:31 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:31 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:31 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858" returned: 0 in 0.838s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:31 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 Jul 07 22:52:31 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-af6ffdea-3668-4ca5-8be5-a6343794de20-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-af6ffdea-3668-4ca5-8be5-a6343794de20-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "cinder-quobyte-af6ffdea-3668-4ca5-8be5-a6343794de20" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-af6ffdea-3668-4ca5-8be5-a6343794de20" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e0be01-02ae-470e-b287-2f3768f09591]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:32 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 Jul 07 22:52:32 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:32 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.740s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:32 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Deleted volume successfully. Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-dcf04970-eb30-4808-a7cf-73e562e0f22e tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-2a77120e-702f-4c10-88ee-69fc8dae74a8-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:32 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:32 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49 Jul 07 22:52:32 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:32 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20" returned: 0 in 0.798s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:32 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20 Jul 07 22:52:32 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:33 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858.d51c948e-8437-4b8e-9171-58e5e002bd49" returned: 0 in 0.708s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-d51c948e-8437-4b8e-9171-58e5e002bd49" released by "_delete_snapshot" :: held 3.358s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-222fa0b4-0045-41d5-ba31-6272029b8858" released by "delete_snapshot" :: held 3.383s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Created reservations ['e7fa9164-78c6-40d2-bd98-95b95117f5be', '5d19adc6-467c-4795-8ac1-7a9f2fd8e4d8', '69d662ab-fbd1-40d5-98ec-71c5a98dec9c', '34530be1-9047-471f-bdb0-3b079652dffa'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:33 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Delete snapshot completed successfully. Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-9e715881-c94f-4599-a86f-cf51eafe8863 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-d51c948e-8437-4b8e-9171-58e5e002bd49-delete_snapshot" released by "delete_snapshot" :: held 3.529s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:33 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-af6ffdea-3668-4ca5-8be5-a6343794de20" returned: 0 in 0.697s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-quobyte-af6ffdea-3668-4ca5-8be5-a6343794de20" released by "delete_volume" :: held 1.544s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Created reservations ['b512aeb3-362e-4be9-83f8-f16d0df43f39', '7a21c74f-d6cb-418a-9917-4aaf87854770', 'eb4b4062-4576-4d15-9208-bdc93841622d', 'ca657fd4-36ad-49a0-816f-87e65097f35e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:33 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:33 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-222fa0b4-0045-41d5-ba31-6272029b8858-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-222fa0b4-0045-41d5-ba31-6272029b8858-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-222fa0b4-0045-41d5-ba31-6272029b8858" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-222fa0b4-0045-41d5-ba31-6272029b8858" acquired by "delete_volume" :: waited 0.014s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ef8d5e-b507-43bc-ad73-934f21bf77c4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:34 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.716s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:34 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Deleted volume successfully. Jul 07 22:52:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4854daf7-e613-45b3-8d47-bb9d927539a0 tempest-VolumeDependencyTests-1434132078 None] Lock "cinder-af6ffdea-3668-4ca5-8be5-a6343794de20-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:34 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 Jul 07 22:52:34 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:35 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:35 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858 Jul 07 22:52:35 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:36 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-222fa0b4-0045-41d5-ba31-6272029b8858" returned: 0 in 0.818s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-222fa0b4-0045-41d5-ba31-6272029b8858" released by "delete_volume" :: held 1.739s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Created reservations ['b13eb7b8-061d-48c5-85e1-e92c584cb16e', 'b885b4f4-a570-4346-af7b-5cead5b27156', '77a8fa93-7f05-424a-bcfc-f3060a4fe11a', '9ac2e4a2-0e92-4338-bc3c-11a8f73208e9'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:36 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:36 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:37 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.816s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:37 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Deleted volume successfully. Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (a5451c48-e65d-47f2-b458-5fbdccd5f3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ffbd21-8083-46e5-ac6c-e347f8352787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-a21c3f43-3f80-4169-894c-ce7ba2470598 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-222fa0b4-0045-41d5-ba31-6272029b8858-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ffbd21-8083-46e5-ac6c-e347f8352787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1806426883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07757b52-1301-4a4b-9201-56a9a482eae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:37Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf099d1-16b3-4a84-9e41-0ca2d8e6f7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf099d1-16b3-4a84-9e41-0ca2d8e6f7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545630ee-9c9e-455c-b3f2-ea8a06bbc800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545630ee-9c9e-455c-b3f2-ea8a06bbc800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07757b52-1301-4a4b-9201-56a9a482eae5', 'volume_name': 'volume-07757b52-1301-4a4b-9201-56a9a482eae5', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e2cb00-4622-405f-ad4f-c3dc7171cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e2cb00-4622-405f-ad4f-c3dc7171cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0b3647-29ad-431a-be56-7b04cbdb717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:37 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Volume 07757b52-1301-4a4b-9201-56a9a482eae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07757b52-1301-4a4b-9201-56a9a482eae5', 'volume_size': 1} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1806426883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07757b52-1301-4a4b-9201-56a9a482eae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85909d499915444dbfb4ed5ab282f5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:37Z,use_quota=True,user_id='7ee2e6eb33af43c69731a0bb58768bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Creating volume 07757b52-1301-4a4b-9201-56a9a482eae5 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:37 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:52:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:37 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 1073741824 Jul 07 22:52:37 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:38 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 1073741824" returned: 0 in 0.873s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:38 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 Jul 07 22:52:38 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ff7808e-c8a7-4f71-be02-e0bdbaeb7708 tempest-ProjectAdminTests-718698741 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7212715148926, 'free_capacity_gb': 1775.7212715148926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87612) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 22:52:38 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5" returned: 0 in 0.697s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0b3647-29ad-431a-be56-7b04cbdb717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07757b52-1301-4a4b-9201-56a9a482eae5', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5945c91-0345-42be-a705-31ab119c744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:38 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Volume volume-07757b52-1301-4a4b-9201-56a9a482eae5 (07757b52-1301-4a4b-9201-56a9a482eae5): created successfully Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5945c91-0345-42be-a705-31ab119c744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Flow 'volume_create_manager' (a5451c48-e65d-47f2-b458-5fbdccd5f3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:38 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-1ee5276d-56c2-48a3-8db4-4ddeafee0e2c tempest-ProjectReaderTests-1081494454 None] Created volume successfully. Jul 07 22:52:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Creating offline snapshot f57923f5-f186-49bc-ac76-eb841c4d6d4a of volume 07757b52-1301-4a4b-9201-56a9a482eae5 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:52:39 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4397407-1db0-41ac-8ad0-8fff1aa2afee]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:39 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 Jul 07 22:52:39 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:40 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5" returned: 0 in 0.824s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:40 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a 1G Jul 07 22:52:40 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:41 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a 1G" returned: 0 in 0.810s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07757b52-1301-4a4b-9201-56a9a482eae5 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:41 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07757b52-1301-4a4b-9201-56a9a482eae5 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a Jul 07 22:52:41 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:41 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07757b52-1301-4a4b-9201-56a9a482eae5 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a" returned: 0 in 0.783s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:41 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a is being set with open permissions: ugo+rw Jul 07 22:52:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:41 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a Jul 07 22:52:41 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:42 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a" returned: 0 in 0.732s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:42 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.info Jul 07 22:52:42 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (8282cd20-2f5e-423b-aed2-f37c6238113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e681abad-2974-4b9b-9811-33d88fbcc948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e681abad-2974-4b9b-9811-33d88fbcc948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1153592240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48fef9e-4606-47a8-9f62-066bd03a9c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:43Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1516cd-dee0-4b8d-bf9d-0c013fb7383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1516cd-dee0-4b8d-bf9d-0c013fb7383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:42 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844fa6da-f79c-4e62-aa9a-bb42edea391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844fa6da-f79c-4e62-aa9a-bb42edea391d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c48fef9e-4606-47a8-9f62-066bd03a9c6d', 'volume_name': 'volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e5c568-ace6-4526-9dc1-b0dbb73038f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e5c568-ace6-4526-9dc1-b0dbb73038f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c7270c-7015-448c-b62a-3d3fad8ec070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:43 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Volume c48fef9e-4606-47a8-9f62-066bd03a9c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d', 'volume_size': 1} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:43 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.info" returned: 0 in 0.727s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:43 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.info is being set with open permissions: ugo+rw Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:43 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.info Jul 07 22:52:43 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:43 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.info" returned: 0 in 0.665s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.631s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1153592240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48fef9e-4606-47a8-9f62-066bd03a9c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:43Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Creating volume c48fef9e-4606-47a8-9f62-066bd03a9c6d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:43 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:52:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:44 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d 1073741824 Jul 07 22:52:44 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:44 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c920badb-9e22-47fd-bb77-40ef66f2c345 tempest-ProjectReaderTests-1081494454 None] Create snapshot completed successfully Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-f57923f5-f186-49bc-ac76-eb841c4d6d4a-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-f57923f5-f186-49bc-ac76-eb841c4d6d4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-07757b52-1301-4a4b-9201-56a9a482eae5" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-07757b52-1301-4a4b-9201-56a9a482eae5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-f57923f5-f186-49bc-ac76-eb841c4d6d4a" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-f57923f5-f186-49bc-ac76-eb841c4d6d4a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Deleting offline snapshot f57923f5-f186-49bc-ac76-eb841c4d6d4a of volume 07757b52-1301-4a4b-9201-56a9a482eae5 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] snapshot_file for this snap is: volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfbce57-fdba-4be0-80c0-7c030e794177]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:44 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a Jul 07 22:52:44 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:44 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d 1073741824" returned: 0 in 0.907s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:44 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d Jul 07 22:52:44 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:45 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a" returned: 0 in 0.761s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07757b52-1301-4a4b-9201-56a9a482eae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f96d6a-3a5a-4d75-b158-80d9d9837147]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:45 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d" returned: 0 in 0.639s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c7270c-7015-448c-b62a-3d3fad8ec070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502de5fe-0903-4e48-b6e0-b36daf70456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:45 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 Jul 07 22:52:45 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:45 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Volume volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d (c48fef9e-4606-47a8-9f62-066bd03a9c6d): created successfully Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502de5fe-0903-4e48-b6e0-b36daf70456d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (8282cd20-2f5e-423b-aed2-f37c6238113d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-286b752a-9c66-4f3d-9887-850be1628221 tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:52:46 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5" returned: 0 in 0.777s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:46 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a Jul 07 22:52:46 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot 3a9f07ba-715c-4448-b9a9-19d11b7eb705 of volume c48fef9e-4606-47a8-9f62-066bd03a9c6d {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:52:46 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0553ae-b05d-4dcc-a526-6c7f4ffd6611]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:46 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d Jul 07 22:52:46 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:47 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a" returned: 0 in 0.779s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:47 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a Jul 07 22:52:47 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:47 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d" returned: 0 in 0.784s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:47 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 1G Jul 07 22:52:47 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:47 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5.f57923f5-f186-49bc-ac76-eb841c4d6d4a" returned: 0 in 0.692s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-f57923f5-f186-49bc-ac76-eb841c4d6d4a" released by "_delete_snapshot" :: held 3.110s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-07757b52-1301-4a4b-9201-56a9a482eae5" released by "delete_snapshot" :: held 3.134s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Created reservations ['d6befeac-a4b2-4f00-9bec-df83cebd9046', 'fc9ddf3b-89ac-4010-90b3-cfca346555d9', 'fbd0da4d-c958-451c-b7bf-710f97eedb58', 'a387a664-44e1-46ac-95ec-aac04de08585'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:47 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Delete snapshot completed successfully. Jul 07 22:52:47 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-c3ed2fcd-69fb-438d-8520-6eccbb9bfa19 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-f57923f5-f186-49bc-ac76-eb841c4d6d4a-delete_snapshot" released by "delete_snapshot" :: held 3.310s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:48 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 1G" returned: 0 in 0.870s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:48 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 Jul 07 22:52:48 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:48 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705" returned: 0 in 0.676s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:48 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 is being set with open permissions: ugo+rw Jul 07 22:52:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:48 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 Jul 07 22:52:48 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-07757b52-1301-4a4b-9201-56a9a482eae5-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-07757b52-1301-4a4b-9201-56a9a482eae5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "cinder-quobyte-07757b52-1301-4a4b-9201-56a9a482eae5" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:48 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-07757b52-1301-4a4b-9201-56a9a482eae5" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d578f037-1a6a-4471-9a0a-33514e15ff79]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:49 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 Jul 07 22:52:49 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:49 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705" returned: 0 in 0.741s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:49 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.info Jul 07 22:52:49 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:49 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5" returned: 0 in 0.817s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:49 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5 Jul 07 22:52:49 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:50 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.info" returned: 0 in 0.725s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:50 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.info is being set with open permissions: ugo+rw Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:50 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.info Jul 07 22:52:50 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:50 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-07757b52-1301-4a4b-9201-56a9a482eae5" returned: 0 in 0.690s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-quobyte-07757b52-1301-4a4b-9201-56a9a482eae5" released by "delete_volume" :: held 1.581s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Created reservations ['dcd88b2b-ef6f-45f0-954e-0abe94ab139e', '520a8bd9-190d-4be5-97a1-ee292154a54b', '5c10744a-8a4e-41ec-8fad-d1bf5782aa7e', '2b4b55fe-1896-4104-b20c-453eda7ded5e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:50 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:50 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:50 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.info" returned: 0 in 0.725s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.626s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:50 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6c414b5a-ce43-4bfe-80be-4928bb423924 tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:52:51 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.762s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:51 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Deleted volume successfully. Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-b13e34a7-52a6-491f-af29-95322b0fcd97 tempest-ProjectReaderTests-1081494454 None] Lock "cinder-07757b52-1301-4a4b-9201-56a9a482eae5-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-3a9f07ba-715c-4448-b9a9-19d11b7eb705-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Lock "cinder-3a9f07ba-715c-4448-b9a9-19d11b7eb705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-c48fef9e-4606-47a8-9f62-066bd03a9c6d" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-c48fef9e-4606-47a8-9f62-066bd03a9c6d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-3a9f07ba-715c-4448-b9a9-19d11b7eb705" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-3a9f07ba-715c-4448-b9a9-19d11b7eb705" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot 3a9f07ba-715c-4448-b9a9-19d11b7eb705 of volume c48fef9e-4606-47a8-9f62-066bd03a9c6d {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b71f97e-9ed4-4727-919c-cc09af3cd977]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:51 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 Jul 07 22:52:51 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:52 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705" returned: 0 in 0.860s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:52:52 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2db284-b236-4b8b-9cda-86c9d8c3fb00]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:52 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d Jul 07 22:52:52 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:53 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d" returned: 0 in 0.973s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:53 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 Jul 07 22:52:53 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:54 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705" returned: 0 in 0.796s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:54 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705 Jul 07 22:52:54 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:55 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d.3a9f07ba-715c-4448-b9a9-19d11b7eb705" returned: 0 in 0.742s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-3a9f07ba-715c-4448-b9a9-19d11b7eb705" released by "_delete_snapshot" :: held 3.532s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-c48fef9e-4606-47a8-9f62-066bd03a9c6d" released by "delete_snapshot" :: held 3.564s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Created reservations ['36349a06-056a-4607-8700-afc2059a66d3', 'de3a627d-c432-4ebf-a01d-f5a087c7d0b4', '61ab25f0-71c3-4053-9cf1-4f4821a29eb3', '9bc4c3f0-9f06-451a-a71f-f8751fe0e44b'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:55 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-6ae09c4a-ebc4-4e8a-845a-0e77a8ffe5ab tempest-ProjectMemberTests-1573472881 None] Lock "cinder-3a9f07ba-715c-4448-b9a9-19d11b7eb705-delete_snapshot" released by "delete_snapshot" :: held 3.781s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-c48fef9e-4606-47a8-9f62-066bd03a9c6d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:55 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:55 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:55 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-c48fef9e-4606-47a8-9f62-066bd03a9c6d-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-c48fef9e-4606-47a8-9f62-066bd03a9c6d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-c48fef9e-4606-47a8-9f62-066bd03a9c6d" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c644182-0ce6-4ccc-9dad-9db8ef9df452]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:56 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d Jul 07 22:52:56 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:56 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.843s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:52:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:52:57 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d" returned: 0 in 1.009s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:57 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d Jul 07 22:52:57 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:57 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-c48fef9e-4606-47a8-9f62-066bd03a9c6d" returned: 0 in 0.751s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:57 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-c48fef9e-4606-47a8-9f62-066bd03a9c6d" released by "delete_volume" :: held 1.838s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:57 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Created reservations ['c6a331b7-4569-4b85-843c-c1e48068fb5f', '9bcfbae3-100f-45f3-946a-c1de97fe2ebb', '38586911-d3b3-4fc8-9d80-8b5b44366095', '12d10b73-220a-4350-ab2f-7cfc092e1afe'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:58 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:52:58 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (aaae9b39-2709-4c09-9acd-9c1076e61f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1c77fb-a656-4665-a8bc-1b917f6028e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1c77fb-a656-4665-a8bc-1b917f6028e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840143553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0831a87-7468-43f5-bf97-7a352ae5078c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:59Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4710f88-4026-49e7-b984-d411a98b9a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4710f88-4026-49e7-b984-d411a98b9a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719c876d-baab-487b-bbff-2749cb122f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719c876d-baab-487b-bbff-2749cb122f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0831a87-7468-43f5-bf97-7a352ae5078c', 'volume_name': 'volume-d0831a87-7468-43f5-bf97-7a352ae5078c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7c3bcd-5f2a-48f8-ba96-4bbe56098d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7c3bcd-5f2a-48f8-ba96-4bbe56098d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfda884e-cb4a-4cf1-9ea9-4d95c4522f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:52:58 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Volume d0831a87-7468-43f5-bf97-7a352ae5078c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0831a87-7468-43f5-bf97-7a352ae5078c', 'volume_size': 1} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840143553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0831a87-7468-43f5-bf97-7a352ae5078c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:59Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Creating volume d0831a87-7468-43f5-bf97-7a352ae5078c {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:52:58 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:58 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.681s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:52:58 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c 1073741824 Jul 07 22:52:58 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:52:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:52:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c36a723-cdf1-410f-8e61-15d57d20d9c8 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-c48fef9e-4606-47a8-9f62-066bd03a9c6d-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:52:59 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Jul 07 22:52:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c 1073741824" returned: 0 in 0.864s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:52:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:52:59 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c Jul 07 22:52:59 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:00 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c" returned: 0 in 0.739s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfda884e-cb4a-4cf1-9ea9-4d95c4522f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0831a87-7468-43f5-bf97-7a352ae5078c', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b53050f-0eca-49df-9b4b-d404e62f883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:00 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Volume volume-d0831a87-7468-43f5-bf97-7a352ae5078c (d0831a87-7468-43f5-bf97-7a352ae5078c): created successfully Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b53050f-0eca-49df-9b4b-d404e62f883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (aaae9b39-2709-4c09-9acd-9c1076e61f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:00 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-46beecd6-7922-437b-9524-f6c9946c09ed tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot 5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe of volume d0831a87-7468-43f5-bf97-7a352ae5078c {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f91173-67bc-4e1b-b52d-c1a2ef81af14]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:01 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c Jul 07 22:53:01 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:01 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c" returned: 0 in 0.878s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:01 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe 1G Jul 07 22:53:01 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:02 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe 1G" returned: 0 in 0.945s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0831a87-7468-43f5-bf97-7a352ae5078c -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:02 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0831a87-7468-43f5-bf97-7a352ae5078c -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe Jul 07 22:53:02 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:03 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0831a87-7468-43f5-bf97-7a352ae5078c -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe" returned: 0 in 0.810s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:03 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe is being set with open permissions: ugo+rw Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:03 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe Jul 07 22:53:03 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Flow 'volume_create_manager' (a6b03e3b-4be8-415b-b615-6f9720c15a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3444fb4-5df6-4b8e-a7a0-3d47a76e234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3444fb4-5df6-4b8e-a7a0-3d47a76e234c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984939123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d96136-4e1c-4c43-a561-a35498196c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e1fe1df662441cbf674a9ffc5dee1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:04Z,use_quota=True,user_id='8ddba89c39494c1cb3b0d21048134efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a718d69-7f27-4917-8420-3b2d83b18995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a718d69-7f27-4917-8420-3b2d83b18995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04e679b-e123-4b03-9d03-043d91b14d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04e679b-e123-4b03-9d03-043d91b14d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d96136-4e1c-4c43-a561-a35498196c13', 'volume_name': 'volume-b2d96136-4e1c-4c43-a561-a35498196c13', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa5fddb-64f6-40ef-8c07-104a8e0988ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa5fddb-64f6-40ef-8c07-104a8e0988ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe57edd-4cf6-4ecf-beab-c871cfaea82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:03 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Volume b2d96136-4e1c-4c43-a561-a35498196c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d96136-4e1c-4c43-a561-a35498196c13', 'volume_size': 1} Jul 07 22:53:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:04 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe" returned: 0 in 0.734s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:04 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.info Jul 07 22:53:04 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:05 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.info" returned: 0 in 0.850s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:05 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.info is being set with open permissions: ugo+rw Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:05 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.info Jul 07 22:53:05 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:05 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.info" returned: 0 in 0.689s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.033s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984939123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d96136-4e1c-4c43-a561-a35498196c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e1fe1df662441cbf674a9ffc5dee1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:04Z,use_quota=True,user_id='8ddba89c39494c1cb3b0d21048134efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Creating volume b2d96136-4e1c-4c43-a561-a35498196c13 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:05 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:53:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:05 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 1073741824 Jul 07 22:53:05 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:06 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2cd55bae-2863-4bf8-94c9-a926e176128d tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-d0831a87-7468-43f5-bf97-7a352ae5078c" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-d0831a87-7468-43f5-bf97-7a352ae5078c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot 5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe of volume d0831a87-7468-43f5-bf97-7a352ae5078c {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c1bad-ba51-4f90-9475-d1d93474e43c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:06 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe Jul 07 22:53:06 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:06 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 1073741824" returned: 0 in 0.953s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:06 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 Jul 07 22:53:06 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:07 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe" returned: 0 in 0.909s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0831a87-7468-43f5-bf97-7a352ae5078c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4f73d8-805f-44c1-9f05-64849a4196ef]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:07 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c Jul 07 22:53:07 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:07 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13" returned: 0 in 0.756s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe57edd-4cf6-4ecf-beab-c871cfaea82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d96136-4e1c-4c43-a561-a35498196c13', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46828387-964c-4a32-ae0a-bf93c2221fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Volume volume-b2d96136-4e1c-4c43-a561-a35498196c13 (b2d96136-4e1c-4c43-a561-a35498196c13): created successfully Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46828387-964c-4a32-ae0a-bf93c2221fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Flow 'volume_create_manager' (a6b03e3b-4be8-415b-b615-6f9720c15a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a8447ab4-2776-407c-aff4-4d2895ed67f7 tempest-ProjectReaderTests-1437306924 None] Created volume successfully. Jul 07 22:53:08 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c" returned: 0 in 0.890s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:08 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe Jul 07 22:53:08 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Acquiring lock "cinder-b2d96136-4e1c-4c43-a561-a35498196c13-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Lock "cinder-b2d96136-4e1c-4c43-a561-a35498196c13-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Acquiring lock "cinder-quobyte-b2d96136-4e1c-4c43-a561-a35498196c13" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Lock "cinder-quobyte-b2d96136-4e1c-4c43-a561-a35498196c13" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c05cef4-e8f5-4567-b04a-4d1d22e7b90f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:08 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 Jul 07 22:53:08 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:08 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe" returned: 0 in 0.854s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:09 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe Jul 07 22:53:09 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:09 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13" returned: 0 in 0.857s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:09 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13 Jul 07 22:53:09 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:09 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c.5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe" returned: 0 in 0.732s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe" released by "_delete_snapshot" :: held 3.521s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-d0831a87-7468-43f5-bf97-7a352ae5078c" released by "delete_snapshot" :: held 3.545s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:09 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Created reservations ['e048982e-79f7-4423-bed3-16ddba32a773', 'bb39ad00-3e6c-40e1-a473-4b86584627a9', '53b3a3f1-48a5-45fb-85e3-57a8399a4afe', '0611730d-faa6-4592-b224-977306281ee7'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:09 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:53:09 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0c1158a-15bd-42ba-a30f-54cad03e2e1e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-5818fe2b-eea6-4c1b-bb6f-e287e5e7b7fe-delete_snapshot" released by "delete_snapshot" :: held 3.736s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:10 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-b2d96136-4e1c-4c43-a561-a35498196c13" returned: 0 in 0.807s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Lock "cinder-quobyte-b2d96136-4e1c-4c43-a561-a35498196c13" released by "delete_volume" :: held 1.723s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Created reservations ['c5d8ab43-5293-4d01-a2e2-558d6f239d24', '518e5760-0b94-4e0f-b4a3-ef01a5dac1d9', '8a4825a3-5a9b-4629-9043-bbaf9aa40e59', '57653b49-2b2e-4483-86b1-2a03a83f7e0a'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:10 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:53:10 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-d0831a87-7468-43f5-bf97-7a352ae5078c-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-d0831a87-7468-43f5-bf97-7a352ae5078c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-d0831a87-7468-43f5-bf97-7a352ae5078c" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-d0831a87-7468-43f5-bf97-7a352ae5078c" acquired by "delete_volume" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[67148d0e-5ed1-4a04-8bbc-e2024e322c9b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:10 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c Jul 07 22:53:10 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:11 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.858s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Deleted volume successfully. Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Flow 'volume_create_manager' (91fe3870-629d-4556-be72-8c8f77eeb59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea0661b-44fc-4018-a56d-fd43d2d490f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-d02ab969-518d-46bb-8f6a-9e1abed3043c tempest-ProjectReaderTests-1437306924 None] Lock "cinder-b2d96136-4e1c-4c43-a561-a35498196c13-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea0661b-44fc-4018-a56d-fd43d2d490f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066591727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e1fe1df662441cbf674a9ffc5dee1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:11Z,use_quota=True,user_id='8ddba89c39494c1cb3b0d21048134efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d49b96-4f86-4664-92dd-96acc7e64463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d49b96-4f86-4664-92dd-96acc7e64463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea33408-3971-4fda-a72b-1cf1a1a4d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea33408-3971-4fda-a72b-1cf1a1a4d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7', 'volume_name': 'volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173262cd-1419-429f-beef-f1aa4e954732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173262cd-1419-429f-beef-f1aa4e954732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b254364b-8115-4ef8-90e5-cb2b3e91704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:11 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Volume a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7', 'volume_size': 1} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066591727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e1fe1df662441cbf674a9ffc5dee1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:11Z,use_quota=True,user_id='8ddba89c39494c1cb3b0d21048134efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Creating volume a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:11 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:11 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 1073741824 Jul 07 22:53:11 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:11 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c" returned: 0 in 0.922s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:11 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c Jul 07 22:53:11 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:12 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 1073741824" returned: 0 in 0.924s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:12 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 Jul 07 22:53:12 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:12 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-d0831a87-7468-43f5-bf97-7a352ae5078c" returned: 0 in 0.821s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-d0831a87-7468-43f5-bf97-7a352ae5078c" released by "delete_volume" :: held 1.821s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Created reservations ['e589c685-d780-484c-9bbd-cf86e8dbe80b', '7f1575cf-0385-43d0-a7c1-527af76365fa', '57e872fe-477b-40d4-9379-1330b1cf931a', '146c041b-ef6e-41a0-b72d-39599f01122e'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:12 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:53:12 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:12 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7" returned: 0 in 0.744s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b254364b-8115-4ef8-90e5-cb2b3e91704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb96216a-a89d-453c-b0b3-435e76f393ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:13 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Volume volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 (a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7): created successfully Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb96216a-a89d-453c-b0b3-435e76f393ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Flow 'volume_create_manager' (91fe3870-629d-4556-be72-8c8f77eeb59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-0583d840-f1b1-414b-874e-760833d70af6 tempest-ProjectReaderTests-1437306924 None] Created volume successfully. Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Acquiring lock "cinder-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Lock "cinder-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:13 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Acquiring lock "cinder-quobyte-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.825s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:13 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Lock "cinder-quobyte-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7" acquired by "delete_volume" :: waited 0.040s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5783d738-6fb9-4a3c-bcf2-ee9efe1cfca1 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-d0831a87-7468-43f5-bf97-7a352ae5078c-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cbd899-ae3b-40f9-b7e9-c8b60166eae4]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (8364946a-6081-4afd-ab01-c571ca4308a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d6ab07-16db-4744-bfe4-d0113681ca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d6ab07-16db-4744-bfe4-d0113681ca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53277365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bfd80f-6c99-4f54-9057-1c9d10ee1730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:13Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326a6767-70f6-4fc4-805c-d666ba0cdec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326a6767-70f6-4fc4-805c-d666ba0cdec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cc8f25-321d-4bbc-9dd8-efe481ac87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cc8f25-321d-4bbc-9dd8-efe481ac87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05bfd80f-6c99-4f54-9057-1c9d10ee1730', 'volume_name': 'volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0b4d5e-6996-43b5-b210-44461ce98157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0b4d5e-6996-43b5-b210-44461ce98157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc33b29-76f7-4115-9344-1b38b16bfcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:13 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Volume 05bfd80f-6c99-4f54-9057-1c9d10ee1730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730', 'volume_size': 1} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53277365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bfd80f-6c99-4f54-9057-1c9d10ee1730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:13Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Creating volume 05bfd80f-6c99-4f54-9057-1c9d10ee1730 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:13 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 Jul 07 22:53:13 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:13 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:53:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:13 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 1073741824 Jul 07 22:53:13 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:14 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:14 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7 Jul 07 22:53:14 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:14 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 1073741824" returned: 0 in 0.894s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:14 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 Jul 07 22:53:14 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:15 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7" returned: 0 in 0.705s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Lock "cinder-quobyte-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7" released by "delete_volume" :: held 1.610s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Created reservations ['fc8c7a3e-de32-4238-843b-161da5d586e5', '5e62a03d-2feb-444f-896b-f0828890c8f6', '76802142-e6e9-4764-a712-12f94792d5c6', 'cb6cc68d-2f7d-4f61-b1f7-0abdfe0c2fe7'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:15 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:53:15 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:15 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730" returned: 0 in 0.799s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc33b29-76f7-4115-9344-1b38b16bfcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e44f94-b729-42a5-b9c1-60f35d87623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:15 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Volume volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 (05bfd80f-6c99-4f54-9057-1c9d10ee1730): created successfully Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e44f94-b729-42a5-b9c1-60f35d87623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (8364946a-6081-4afd-ab01-c571ca4308a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-36b8a02b-4473-4a7e-82c9-e76777200162 tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:53:15 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.741s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:15 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Deleted volume successfully. Jul 07 22:53:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5c88056c-d36d-426c-b2a8-6d51e4b0d8e6 tempest-ProjectReaderTests-1437306924 None] Lock "cinder-a8d4b20e-cac7-4e81-a46d-2d8a5c1d2be7-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot 99e18d2b-2183-4a4e-a9fa-88447fb59afe of volume 05bfd80f-6c99-4f54-9057-1c9d10ee1730 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:53:16 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a955b-887d-4939-85c1-0bad22352329]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:16 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 Jul 07 22:53:16 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:17 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730" returned: 0 in 0.942s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:17 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe 1G Jul 07 22:53:17 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:18 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe 1G" returned: 0 in 0.891s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:18 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe Jul 07 22:53:18 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:19 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe" returned: 0 in 0.851s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:19 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe is being set with open permissions: ugo+rw Jul 07 22:53:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:19 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe Jul 07 22:53:19 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:20 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe" returned: 0 in 0.773s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:20 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.info Jul 07 22:53:20 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:21 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.info" returned: 0 in 0.786s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:21 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.info is being set with open permissions: ugo+rw Jul 07 22:53:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:21 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.info Jul 07 22:53:21 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:21 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.info" returned: 0 in 0.822s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.178s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:22 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-79a2df9b-ea2d-403c-bec6-fda809cabf7e tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-99e18d2b-2183-4a4e-a9fa-88447fb59afe-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-99e18d2b-2183-4a4e-a9fa-88447fb59afe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-05bfd80f-6c99-4f54-9057-1c9d10ee1730" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-05bfd80f-6c99-4f54-9057-1c9d10ee1730" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-99e18d2b-2183-4a4e-a9fa-88447fb59afe" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-99e18d2b-2183-4a4e-a9fa-88447fb59afe" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot 99e18d2b-2183-4a4e-a9fa-88447fb59afe of volume 05bfd80f-6c99-4f54-9057-1c9d10ee1730 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[73013c49-5e03-4431-8c3f-1ffead7251e5]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:23 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe Jul 07 22:53:23 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:24 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe" returned: 0 in 0.886s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:24 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:53:24 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e56a2d-0354-4b31-879a-956b9a9dbc3c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:24 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 Jul 07 22:53:24 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:25 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730" returned: 0 in 0.893s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:25 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe Jul 07 22:53:25 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:25 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe" returned: 0 in 0.848s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:25 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe Jul 07 22:53:25 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:26 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730.99e18d2b-2183-4a4e-a9fa-88447fb59afe" returned: 0 in 0.710s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-99e18d2b-2183-4a4e-a9fa-88447fb59afe" released by "_delete_snapshot" :: held 3.508s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-05bfd80f-6c99-4f54-9057-1c9d10ee1730" released by "delete_snapshot" :: held 3.543s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:26 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:DELETE=9,cinder:SELECT=101,cinder:UPDATE=106,cinder:INSERT=24 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:53:26 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:UPDATE=131,cinder:SELECT=82,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:53:26 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Created reservations ['05795102-90ae-4681-8e31-e44f71be3033', '4ed798b9-50f1-4506-8b16-a777925150e8', '780aa828-a4ad-459d-98f7-38931a937f9a', 'b3facb97-5853-4922-bab3-f8079e755935'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:26 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:53:26 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-44e6d997-05d5-4898-bcc7-ac1dd427f5a5 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-99e18d2b-2183-4a4e-a9fa-88447fb59afe-delete_snapshot" released by "delete_snapshot" :: held 3.730s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-05bfd80f-6c99-4f54-9057-1c9d10ee1730-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Lock "cinder-05bfd80f-6c99-4f54-9057-1c9d10ee1730-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-05bfd80f-6c99-4f54-9057-1c9d10ee1730" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:27 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-05bfd80f-6c99-4f54-9057-1c9d10ee1730" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:27 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2038f7c-c477-49cf-84a8-b75907c45da6]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:27 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 Jul 07 22:53:27 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:28 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730" returned: 0 in 0.852s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:28 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730 Jul 07 22:53:28 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:29 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-05bfd80f-6c99-4f54-9057-1c9d10ee1730" returned: 0 in 0.764s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-05bfd80f-6c99-4f54-9057-1c9d10ee1730" released by "delete_volume" :: held 1.681s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Created reservations ['b015a415-018d-42a9-b130-a6857893bef1', 'a215f97b-8326-4583-b18a-880aa8b83d9f', 'e6f51c22-877d-4834-bbc7-d55977c9e85e', 'b007e065-7f64-456e-a26d-1fa824d5e239'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:29 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:53:29 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (dcfd22d4-0ff1-4fe9-bbeb-2fdd025b0996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa4f584-408c-48a0-bc10-f3c635b3fc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa4f584-408c-48a0-bc10-f3c635b3fc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61161424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2fa027-d683-4fae-b41b-d3d803bcfdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:30Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637dbf30-f426-4447-a495-22c17c2d3887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637dbf30-f426-4447-a495-22c17c2d3887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a17d9bb-c473-4ccc-b7f0-164cf6e002e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a17d9bb-c473-4ccc-b7f0-164cf6e002e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2fa027-d683-4fae-b41b-d3d803bcfdc8', 'volume_name': 'volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53bd149-b929-4d69-901c-cee83bd43d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53bd149-b929-4d69-901c-cee83bd43d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53b2765-cbdf-431f-9b59-d8005fb7a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:30 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Volume 7d2fa027-d683-4fae-b41b-d3d803bcfdc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8', 'volume_size': 1} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61161424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2fa027-d683-4fae-b41b-d3d803bcfdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:30Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Creating volume 7d2fa027-d683-4fae-b41b-d3d803bcfdc8 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:30 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 1.087s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:53:30 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-80631ea8-b210-4a1d-996a-7d24931947ec tempest-ProjectMemberTests-1573472881 None] Lock "cinder-05bfd80f-6c99-4f54-9057-1c9d10ee1730-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:30 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 1073741824 Jul 07 22:53:30 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:31 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 1073741824" returned: 0 in 1.074s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:31 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 Jul 07 22:53:31 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:32 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" returned: 0 in 0.901s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53b2765-cbdf-431f-9b59-d8005fb7a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924f8acd-1225-48ed-8d76-2aa2d8bd3bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:32 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Volume volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 (7d2fa027-d683-4fae-b41b-d3d803bcfdc8): created successfully Jul 07 22:53:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924f8acd-1225-48ed-8d76-2aa2d8bd3bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:32 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (dcfd22d4-0ff1-4fe9-bbeb-2fdd025b0996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:32 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-912588d0-b120-42a5-b3fc-30453640456d tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:53:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:33 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot ba11eea4-e512-411b-8bde-630418bec681 of volume 7d2fa027-d683-4fae-b41b-d3d803bcfdc8 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:53:33 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dd780b-13cf-486e-af2c-e8b2b9046bf8]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:33 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 Jul 07 22:53:33 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:34 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" returned: 0 in 0.862s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:34 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 1G Jul 07 22:53:34 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:35 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 1G" returned: 0 in 0.863s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:35 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:35 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 Jul 07 22:53:35 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:36 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681" returned: 0 in 0.809s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:36 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 is being set with open permissions: ugo+rw Jul 07 22:53:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:36 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 Jul 07 22:53:36 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:36 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681" returned: 0 in 0.685s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:36 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.info Jul 07 22:53:36 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:37 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.info" returned: 0 in 0.695s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:37 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.info is being set with open permissions: ugo+rw Jul 07 22:53:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:37 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.info Jul 07 22:53:37 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:38 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.info" returned: 0 in 0.709s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.752s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:38 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-c2460de4-9c8d-4cdb-ba65-52caaa930cdd tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-ba11eea4-e512-411b-8bde-630418bec681-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Lock "cinder-ba11eea4-e512-411b-8bde-630418bec681-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-ba11eea4-e512-411b-8bde-630418bec681" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-ba11eea4-e512-411b-8bde-630418bec681" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot ba11eea4-e512-411b-8bde-630418bec681 of volume 7d2fa027-d683-4fae-b41b-d3d803bcfdc8 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a95e89-4e57-4a96-a2d1-7443dbed3377]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:39 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 Jul 07 22:53:39 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:39 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681" returned: 0 in 0.923s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:39 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:53:39 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fa6782-475c-47b4-9afe-5b2071c9a51e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:40 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 Jul 07 22:53:40 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:40 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" returned: 0 in 0.833s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:40 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 Jul 07 22:53:40 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:41 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681" returned: 0 in 0.921s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:41 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681 Jul 07 22:53:41 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:42 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8.ba11eea4-e512-411b-8bde-630418bec681" returned: 0 in 0.761s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-ba11eea4-e512-411b-8bde-630418bec681" released by "_delete_snapshot" :: held 3.569s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" released by "delete_snapshot" :: held 3.594s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:42 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Created reservations ['66ea20d6-33af-42f7-9ac2-1bbc4b182d3f', 'f2b9ab18-1470-458b-ada8-eaea476928e5', '7301db0e-a6ee-47d7-85b3-0da024dea57b', 'f4ded77a-f575-43dd-ac10-b4a93b074c90'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:42 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:53:42 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-891c79d6-b27c-4f7e-9182-5cbac428e44f tempest-ProjectMemberTests-1573472881 None] Lock "cinder-ba11eea4-e512-411b-8bde-630418bec681-delete_snapshot" released by "delete_snapshot" :: held 3.802s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-7d2fa027-d683-4fae-b41b-d3d803bcfdc8-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Lock "cinder-7d2fa027-d683-4fae-b41b-d3d803bcfdc8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:43 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:43 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[70db2985-7359-4e02-a22d-eda4e9cbac16]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:43 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 Jul 07 22:53:43 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:44 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" returned: 0 in 0.945s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:44 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8 Jul 07 22:53:44 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:45 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" returned: 0 in 0.754s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-7d2fa027-d683-4fae-b41b-d3d803bcfdc8" released by "delete_volume" :: held 1.770s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Created reservations ['b757e095-8475-4c86-b5ee-22c230721ec6', '58430beb-3f1c-45bb-9675-2231f2d8fd1e', 'f5aaeba2-bbe9-4f51-a159-315924984edb', '6a7e3fb5-9269-409d-9ee1-e9ca34c43e91'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:45 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:53:45 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Flow 'volume_create_manager' (e59eb08f-feae-4840-b2a5-61226b0374fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fc5473-b4a8-4aa9-b6ae-6fe1f01214f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fc5473-b4a8-4aa9-b6ae-6fe1f01214f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1776913360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5af80-4cd6-4d5d-b3ff-178ec0f05224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a409c916fb34dbb9801620ca2ce2ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:46Z,use_quota=True,user_id='b9d263b7a9d54f89999bec45e69977a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ccdccb-fcb4-4979-b52c-65975f72de7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ccdccb-fcb4-4979-b52c-65975f72de7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e29e2d-e00e-46e3-b62b-fee8d5df07c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e29e2d-e00e-46e3-b62b-fee8d5df07c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c5af80-4cd6-4d5d-b3ff-178ec0f05224', 'volume_name': 'volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd80f28d-5552-45e2-b6ed-c7ff52da3947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd80f28d-5552-45e2-b6ed-c7ff52da3947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a516d35-3fb1-44e1-8efd-52ca089f6a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:45 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Volume 40c5af80-4cd6-4d5d-b3ff-178ec0f05224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224', 'volume_size': 1} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1776913360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5af80-4cd6-4d5d-b3ff-178ec0f05224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a409c916fb34dbb9801620ca2ce2ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:46Z,use_quota=True,user_id='b9d263b7a9d54f89999bec45e69977a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Creating volume 40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:45 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:53:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:45 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 1073741824 Jul 07 22:53:45 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (27b3b17e-8768-45a4-bd3b-4649fd3d0521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd8384b-8a5d-40af-a96b-dc7a11cc1d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:46 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.860s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd8384b-8a5d-40af-a96b-dc7a11cc1d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963827848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99fdb87-f1e9-4635-8766-8500cd5f913d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:46Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5eb0d07-ccd5-46d2-b721-36256456c922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5eb0d07-ccd5-46d2-b721-36256456c922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5911a5c-a6e3-4dc9-b399-d5c0ccefdca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5911a5c-a6e3-4dc9-b399-d5c0ccefdca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99fdb87-f1e9-4635-8766-8500cd5f913d', 'volume_name': 'volume-f99fdb87-f1e9-4635-8766-8500cd5f913d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2d5027-563d-40bf-a5b2-a14fdbc16dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2d5027-563d-40bf-a5b2-a14fdbc16dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28d8dbd-3e9c-473b-a5ea-ed8c7366147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:46 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Volume f99fdb87-f1e9-4635-8766-8500cd5f913d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99fdb87-f1e9-4635-8766-8500cd5f913d', 'volume_size': 1} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:46 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-7da69c84-fa94-44c5-a110-af8fae027fdc tempest-ProjectMemberTests-1573472881 None] Lock "cinder-7d2fa027-d683-4fae-b41b-d3d803bcfdc8-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:53:46 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 1073741824" returned: 0 in 0.933s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:46 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 Jul 07 22:53:46 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:47 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" returned: 0 in 0.629s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963827848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99fdb87-f1e9-4635-8766-8500cd5f913d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:46Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Creating volume f99fdb87-f1e9-4635-8766-8500cd5f913d {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:47 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a516d35-3fb1-44e1-8efd-52ca089f6a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:47 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d 1073741824 Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36aed11-56aa-4422-873c-8de0df348fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:47 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:47 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Volume volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 (40c5af80-4cd6-4d5d-b3ff-178ec0f05224): created successfully Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36aed11-56aa-4422-873c-8de0df348fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:47 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Flow 'volume_create_manager' (e59eb08f-feae-4840-b2a5-61226b0374fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:47 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-add7c6cd-de80-4b4c-8fbf-72379abc9d2c tempest-SnapshotDependencyTests-1987226724 None] Created volume successfully. Jul 07 22:53:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:48 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d 1073741824" returned: 0 in 0.894s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:48 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d Jul 07 22:53:48 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:48 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d" returned: 0 in 0.648s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:48 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:53:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.929s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28d8dbd-3e9c-473b-a5ea-ed8c7366147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99fdb87-f1e9-4635-8766-8500cd5f913d', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44013ee9-b56f-467e-ab0f-3af6c0eeb753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Creating offline snapshot 7f4115d1-a408-4e3a-a00b-e41dbd8422d2 of volume 40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:53:49 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Volume volume-f99fdb87-f1e9-4635-8766-8500cd5f913d (f99fdb87-f1e9-4635-8766-8500cd5f913d): created successfully Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44013ee9-b56f-467e-ab0f-3af6c0eeb753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (27b3b17e-8768-45a4-bd3b-4649fd3d0521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[235f6f4c-5bbd-4436-aa5f-20022019c503]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:49 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-a7ea1e5c-aa72-409e-b5f0-9c1dd6285220 tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:53:49 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 Jul 07 22:53:49 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:49 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" returned: 0 in 0.815s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:49 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 1G Jul 07 22:53:49 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:50 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 1G" returned: 0 in 0.946s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:50 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 Jul 07 22:53:50 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:51 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2" returned: 0 in 0.720s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:51 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 is being set with open permissions: ugo+rw Jul 07 22:53:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:51 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 Jul 07 22:53:51 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:52 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2" returned: 0 in 0.728s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:52 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.info Jul 07 22:53:52 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:53 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.info" returned: 0 in 0.746s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:53 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.info is being set with open permissions: ugo+rw Jul 07 22:53:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:53 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.info Jul 07 22:53:53 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:53 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.info" returned: 0 in 0.724s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.826s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.300s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot 7550c80c-7e22-4173-9073-fca876715b9a of volume f99fdb87-f1e9-4635-8766-8500cd5f913d {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:53:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-baa06113-2baa-4928-9f86-1edeff6196dc tempest-SnapshotDependencyTests-1987226724 None] Create snapshot completed successfully Jul 07 22:53:53 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafa4864-c3f8-4271-abd5-7c674c65351c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:53 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d Jul 07 22:53:53 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:54 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d" returned: 0 in 0.883s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:54 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a 1G Jul 07 22:53:54 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Flow 'volume_create_manager' (ff842759-b56b-4f8a-8af7-a9d8c1cae6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635b7521-1e89-4fcd-b541-266c1dab4960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635b7521-1e89-4fcd-b541-266c1dab4960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ecb7e0-c55f-4041-9cc7-3aafeed954de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a409c916fb34dbb9801620ca2ce2ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7f4115d1-a408-4e3a-a00b-e41dbd8422d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:55Z,use_quota=True,user_id='b9d263b7a9d54f89999bec45e69977a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f460d192-7a18-4b87-86d1-8bd81e7d9ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f460d192-7a18-4b87-86d1-8bd81e7d9ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdfda81-beb1-4f56-966d-1b616dd213cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdfda81-beb1-4f56-966d-1b616dd213cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '10ecb7e0-c55f-4041-9cc7-3aafeed954de', 'volume_name': 'volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de', 'volume_size': 1, 'snapshot_id': '7f4115d1-a408-4e3a-a00b-e41dbd8422d2'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16fddf2-c260-45fc-a1ba-cf73617e65b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16fddf2-c260-45fc-a1ba-cf73617e65b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e37b563-dfa0-40f7-9955-21933f40e266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:53:55 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Volume 10ecb7e0-c55f-4041-9cc7-3aafeed954de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de', 'volume_size': 1, 'snapshot_id': '7f4115d1-a408-4e3a-a00b-e41dbd8422d2'} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:55 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a 1G" returned: 0 in 0.977s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99fdb87-f1e9-4635-8766-8500cd5f913d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:55 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99fdb87-f1e9-4635-8766-8500cd5f913d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a Jul 07 22:53:55 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:55 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:53:55 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:56 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99fdb87-f1e9-4635-8766-8500cd5f913d -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a" returned: 0 in 0.810s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:56 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a is being set with open permissions: ugo+rw Jul 07 22:53:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:56 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.716s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:53:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:53:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:53:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:53:56 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a Jul 07 22:53:56 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:57 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a" returned: 0 in 0.662s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:57 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.info Jul 07 22:53:57 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:57 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.info" returned: 0 in 0.650s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:57 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.info is being set with open permissions: ugo+rw Jul 07 22:53:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:57 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.info Jul 07 22:53:57 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:58 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.info" returned: 0 in 0.690s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.778s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.378s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-quobyte-7f4115d1-a408-4e3a-a00b-e41dbd8422d2-10ecb7e0-c55f-4041-9cc7-3aafeed954de" by "_create_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-7f4115d1-a408-4e3a-a00b-e41dbd8422d2-10ecb7e0-c55f-4041-9cc7-3aafeed954de" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Creating volume 10ecb7e0-c55f-4041-9cc7-3aafeed954de from snapshot 7f4115d1-a408-4e3a-a00b-e41dbd8422d2 {{(pid=87612) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-quobyte-10ecb7e0-c55f-4041-9cc7-3aafeed954de" by "_copy_volume_from_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:58 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-2e0a0569-ec2b-4789-9705-fb86812dd4cf tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-10ecb7e0-c55f-4041-9cc7-3aafeed954de" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] snapshot: 7f4115d1-a408-4e3a-a00b-e41dbd8422d2, volume: 10ecb7e0-c55f-4041-9cc7-3aafeed954de, {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b82b00-c5fd-4b80-aaae-5f4cb4641209]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:58 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 Jul 07 22:53:58 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-7550c80c-7e22-4173-9073-fca876715b9a-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Lock "cinder-7550c80c-7e22-4173-9073-fca876715b9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-f99fdb87-f1e9-4635-8766-8500cd5f913d" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-f99fdb87-f1e9-4635-8766-8500cd5f913d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-7550c80c-7e22-4173-9073-fca876715b9a" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-7550c80c-7e22-4173-9073-fca876715b9a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot 7550c80c-7e22-4173-9073-fca876715b9a of volume f99fdb87-f1e9-4635-8766-8500cd5f913d {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd1bad-2086-4152-b71f-c48a0364bf42]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:59 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a Jul 07 22:53:59 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:59 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2" returned: 0 in 0.863s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Creating direct copy from snapshot {{(pid=87612) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d882582-e824-4e79-b850-dbcabbd386f1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:59 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 Jul 07 22:53:59 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:53:59 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a" returned: 0 in 0.837s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f99fdb87-f1e9-4635-8766-8500cd5f913d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[0314ff81-e80e-4fd6-8dd9-00bcb996d9cc]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:53:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:53:59 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d Jul 07 22:53:59 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:00 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" returned: 0 in 0.852s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:00 devstack cinder-volume[87612]: DEBUG cinder.utils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Path /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de not found in is_blk_device check {{(pid=87612) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:54:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:00 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de Jul 07 22:54:00 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:00 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d" returned: 0 in 0.854s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:00 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a Jul 07 22:54:00 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:01 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a" returned: 0 in 1.264s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:02 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a Jul 07 22:54:02 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:03 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d.7550c80c-7e22-4173-9073-fca876715b9a" returned: 0 in 1.570s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-7550c80c-7e22-4173-9073-fca876715b9a" released by "_delete_snapshot" :: held 4.681s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-f99fdb87-f1e9-4635-8766-8500cd5f913d" released by "delete_snapshot" :: held 4.712s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:03 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Created reservations ['49b8e443-a53d-4ece-a68a-07a372bc2d84', '1a685fd3-c0b8-4946-a3b1-06e1ea480780', 'bd0f4b13-a348-4426-bf6a-664bbf7ae6bc', '1c1e2f1b-a364-46d7-b419-1c03d7e654fd'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:03 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:54:03 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5f245913-b70a-43d7-bd0a-4bbd258e31ae tempest-ProjectMemberTests-1573472881 None] Lock "cinder-7550c80c-7e22-4173-9073-fca876715b9a-delete_snapshot" released by "delete_snapshot" :: held 5.073s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-f99fdb87-f1e9-4635-8766-8500cd5f913d-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Lock "cinder-f99fdb87-f1e9-4635-8766-8500cd5f913d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-f99fdb87-f1e9-4635-8766-8500cd5f913d" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-f99fdb87-f1e9-4635-8766-8500cd5f913d" acquired by "delete_volume" :: waited 0.032s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:04 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[896f86f2-a36e-44c8-8497-0b99cd00a55b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:04 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d Jul 07 22:54:04 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:05 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de" returned: 0 in 5.382s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:05 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6819ad-7009-47d1-9c6b-4413a8524eae]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:05 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 Jul 07 22:54:05 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:05 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d" returned: 0 in 1.312s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:05 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d Jul 07 22:54:05 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:06 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-f99fdb87-f1e9-4635-8766-8500cd5f913d" returned: 0 in 0.625s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-f99fdb87-f1e9-4635-8766-8500cd5f913d" released by "delete_volume" :: held 2.057s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Created reservations ['66e99d28-7f9f-4813-9259-8e555a40fe55', '3b970b34-b59f-410b-994e-f38e139fb324', 'd8803cfb-f3f7-43f5-98b3-e966aa9cee5c', 'ef6f767b-a72c-46ac-8390-d588e64b0a9c'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:06 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:54:06 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:06 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" returned: 0 in 1.014s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG cinder.image.image_utils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Image conversion details: src /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de {{(pid=87612) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:54:06 devstack cinder-volume[87612]: INFO cinder.image.image_utils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Converted 1024.00 MB image at 190.21 MB/s Jul 07 22:54:06 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de is being set with open permissions: ugo+rw Jul 07 22:54:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:06 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de Jul 07 22:54:06 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (1fa7ed4a-6be1-4ee5-b4bb-4b42b6f805ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8d5f32-b142-4593-a7de-ce7ccc6f6b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8d5f32-b142-4593-a7de-ce7ccc6f6b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250910730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dbabce-0267-44e8-80f5-013f158d8852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:07Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6debe8-878a-48b0-ac34-0592a8250fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6debe8-878a-48b0-ac34-0592a8250fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528e0bd2-acf3-4556-b91f-3596287e34d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528e0bd2-acf3-4556-b91f-3596287e34d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57dbabce-0267-44e8-80f5-013f158d8852', 'volume_name': 'volume-57dbabce-0267-44e8-80f5-013f158d8852', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4335b8-d140-43b2-a53a-c695d8db516b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4335b8-d140-43b2-a53a-c695d8db516b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82760ff-7807-47ae-a2cc-464a419420c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Volume 57dbabce-0267-44e8-80f5-013f158d8852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57dbabce-0267-44e8-80f5-013f158d8852', 'volume_size': 1} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:07 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.818s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:07 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de" returned: 0 in 0.748s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-10ecb7e0-c55f-4041-9cc7-3aafeed954de" released by "_copy_volume_from_snapshot" :: held 8.961s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-7f4115d1-a408-4e3a-a00b-e41dbd8422d2-10ecb7e0-c55f-4041-9cc7-3aafeed954de" released by "_create_volume_from_snapshot" :: held 9.001s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.027s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250910730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dbabce-0267-44e8-80f5-013f158d8852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:07Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Creating volume 57dbabce-0267-44e8-80f5-013f158d8852 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:07 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-235cc4cf-0e6a-4841-808b-ea57b203860c tempest-ProjectMemberTests-1573472881 None] Lock "cinder-f99fdb87-f1e9-4635-8766-8500cd5f913d-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:07 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 1073741824 Jul 07 22:54:07 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e37b563-dfa0-40f7-9955-21933f40e266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de', 'volume_size': 1, 'snapshot_id': '7f4115d1-a408-4e3a-a00b-e41dbd8422d2'}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4abc61-04a5-4825-9b02-98d19113fe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:07 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Volume volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de (10ecb7e0-c55f-4041-9cc7-3aafeed954de): created successfully Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4abc61-04a5-4825-9b02-98d19113fe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:07 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Flow 'volume_create_manager' (ff842759-b56b-4f8a-8af7-a9d8c1cae6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-36180f43-be84-40e7-bc97-12c6a39b70ac tempest-SnapshotDependencyTests-1987226724 None] Created volume successfully. Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-7f4115d1-a408-4e3a-a00b-e41dbd8422d2-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-7f4115d1-a408-4e3a-a00b-e41dbd8422d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-quobyte-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-quobyte-7f4115d1-a408-4e3a-a00b-e41dbd8422d2" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-7f4115d1-a408-4e3a-a00b-e41dbd8422d2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Deleting offline snapshot 7f4115d1-a408-4e3a-a00b-e41dbd8422d2 of volume 40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] snapshot_file for this snap is: volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38a3ac4-063c-42a4-9de9-d95f62a0143f]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:08 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 1073741824" returned: 0 in 0.909s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:08 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:08 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 Jul 07 22:54:08 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:08 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 Jul 07 22:54:08 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:09 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2" returned: 0 in 0.800s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:54:09 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ecc2ab-7516-48e5-86c0-4c9f2a165318]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852" returned: 0 in 0.731s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82760ff-7807-47ae-a2cc-464a419420c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57dbabce-0267-44e8-80f5-013f158d8852', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a8d4e3-ee05-4d98-b286-6fa54670930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:09 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Volume volume-57dbabce-0267-44e8-80f5-013f158d8852 (57dbabce-0267-44e8-80f5-013f158d8852): created successfully Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a8d4e3-ee05-4d98-b286-6fa54670930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:09 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (1fa7ed4a-6be1-4ee5-b4bb-4b42b6f805ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:09 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-05f36625-ff01-41cc-9f86-cb039e0123c2 tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:54:09 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 Jul 07 22:54:09 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:10 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" returned: 0 in 0.792s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:10 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 Jul 07 22:54:10 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot 2da2c938-be6e-4a7a-bb2f-7a3516f15d17 of volume 57dbabce-0267-44e8-80f5-013f158d8852 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[710745ee-8cde-47bf-973d-2fee7d6edcec]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:10 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 Jul 07 22:54:10 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:10 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2" returned: 0 in 0.867s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:10 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:10 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2 Jul 07 22:54:10 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:11 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852" returned: 0 in 0.855s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:11 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:11 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224.7f4115d1-a408-4e3a-a00b-e41dbd8422d2" returned: 0 in 0.714s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:11 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 1G Jul 07 22:54:11 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-7f4115d1-a408-4e3a-a00b-e41dbd8422d2" released by "_delete_snapshot" :: held 3.290s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" released by "delete_snapshot" :: held 3.316s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:11 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Created reservations ['b54e9a72-ddeb-42ce-a394-ea1d9b37dec6', '2c690667-6ef3-4a49-91c7-17682c0a48e0', '550fa01d-b6cc-4583-ba4e-e8b4d6c09b07', '7c267f49-68f2-4256-a24e-9cac61c0fdd3'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:11 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Delete snapshot completed successfully. Jul 07 22:54:11 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-4ca628a3-d4f1-438c-b602-eef1da918e73 tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-7f4115d1-a408-4e3a-a00b-e41dbd8422d2-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:12 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 1G" returned: 0 in 0.913s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57dbabce-0267-44e8-80f5-013f158d8852 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:12 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57dbabce-0267-44e8-80f5-013f158d8852 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 Jul 07 22:54:12 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-40c5af80-4cd6-4d5d-b3ff-178ec0f05224-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-40c5af80-4cd6-4d5d-b3ff-178ec0f05224-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-quobyte-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:12 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:12 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[824681a2-3f0c-4f74-9730-11783f6870ea]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:12 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:12 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 Jul 07 22:54:12 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:13 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57dbabce-0267-44e8-80f5-013f158d8852 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17" returned: 0 in 0.773s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:13 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 is being set with open permissions: ugo+rw Jul 07 22:54:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:13 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 Jul 07 22:54:13 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:13 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" returned: 0 in 0.868s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:13 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:13 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224 Jul 07 22:54:13 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:14 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17" returned: 0 in 0.708s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:14 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.info Jul 07 22:54:14 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:14 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" returned: 0 in 0.734s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-40c5af80-4cd6-4d5d-b3ff-178ec0f05224" released by "delete_volume" :: held 1.672s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Created reservations ['46f8585f-2452-491c-a2df-8b6f9f6ec2d6', '9ec99607-25b7-45e4-afaa-398de033da02', '49d3470f-44c2-4785-95dc-2820ecc9dbaf', '1fe35450-751e-41c1-9e90-06e1b6a7b944'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:14 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:54:14 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:14 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.info" returned: 0 in 0.719s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:14 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.info is being set with open permissions: ugo+rw Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:14 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.info Jul 07 22:54:14 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-10ecb7e0-c55f-4041-9cc7-3aafeed954de-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-10ecb7e0-c55f-4041-9cc7-3aafeed954de-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "cinder-quobyte-10ecb7e0-c55f-4041-9cc7-3aafeed954de" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:14 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-10ecb7e0-c55f-4041-9cc7-3aafeed954de" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4790df8-8477-4e65-b4d6-260f19571c45]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:15 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de Jul 07 22:54:15 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:15 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.765s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Deleted volume successfully. Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-aaa6a753-9466-4910-84f7-899a5f4ab48b tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-40c5af80-4cd6-4d5d-b3ff-178ec0f05224-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:15 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.info" returned: 0 in 0.882s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.941s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:15 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-499eea8b-9475-40a4-80d3-ba68be3baf3c tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:54:15 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de" returned: 0 in 0.824s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:15 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:15 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de Jul 07 22:54:15 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-2da2c938-be6e-4a7a-bb2f-7a3516f15d17-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Lock "cinder-2da2c938-be6e-4a7a-bb2f-7a3516f15d17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-57dbabce-0267-44e8-80f5-013f158d8852" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-57dbabce-0267-44e8-80f5-013f158d8852" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-2da2c938-be6e-4a7a-bb2f-7a3516f15d17" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-2da2c938-be6e-4a7a-bb2f-7a3516f15d17" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot 2da2c938-be6e-4a7a-bb2f-7a3516f15d17 of volume 57dbabce-0267-44e8-80f5-013f158d8852 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7647f65-a1b1-4efd-bdaf-45ef7eecf032]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:16 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 Jul 07 22:54:16 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:16 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-10ecb7e0-c55f-4041-9cc7-3aafeed954de" returned: 0 in 0.748s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-quobyte-10ecb7e0-c55f-4041-9cc7-3aafeed954de" released by "delete_volume" :: held 1.638s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Created reservations ['90a77fa7-09a0-4c57-affb-903f9850af5b', 'fba9246b-481f-49e6-9ef3-b27f5c6b362f', 'eebeac26-0ff1-4c00-bb06-ab7cbcc9039c', 'bb1d4cba-2b39-4e4d-87ee-530a42484932'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:16 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:16 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:54:16 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:17 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17" returned: 0 in 0.838s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57dbabce-0267-44e8-80f5-013f158d8852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dc83d1-9c8e-44ce-bbcb-dce1a6f64f41]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:17 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 Jul 07 22:54:17 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:17 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.796s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:17 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Deleted volume successfully. Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-5d7012bb-b61e-4d33-a069-f9114423f5dc tempest-SnapshotDependencyTests-1987226724 None] Lock "cinder-10ecb7e0-c55f-4041-9cc7-3aafeed954de-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:17 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852" returned: 0 in 0.844s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:17 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:17 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 Jul 07 22:54:17 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:18 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17" returned: 0 in 0.810s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:18 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:18 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17 Jul 07 22:54:18 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:19 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:19 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852.2da2c938-be6e-4a7a-bb2f-7a3516f15d17" returned: 0 in 0.743s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-2da2c938-be6e-4a7a-bb2f-7a3516f15d17" released by "_delete_snapshot" :: held 3.344s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-57dbabce-0267-44e8-80f5-013f158d8852" released by "delete_snapshot" :: held 3.369s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:19 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Created reservations ['30f3fa29-5be6-4594-b792-63531e367b1d', '675fe589-51d1-48f7-8746-d54c14fd8941', '1c780fed-bd35-4867-8302-bcc6eefa3b26', '548c96dc-45c7-4148-abff-116befeb8a1a'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:19 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:54:19 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f0738280-86f5-4849-ab1c-91915c2214ad tempest-ProjectMemberTests-1573472881 None] Lock "cinder-2da2c938-be6e-4a7a-bb2f-7a3516f15d17-delete_snapshot" released by "delete_snapshot" :: held 3.523s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-57dbabce-0267-44e8-80f5-013f158d8852-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-57dbabce-0267-44e8-80f5-013f158d8852-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-57dbabce-0267-44e8-80f5-013f158d8852" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:20 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-57dbabce-0267-44e8-80f5-013f158d8852" acquired by "delete_volume" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:20 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84af995-d113-4c15-8968-6191a25c4384]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:20 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:20 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 Jul 07 22:54:20 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:21 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852" returned: 0 in 0.922s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:21 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:21 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852 Jul 07 22:54:21 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:22 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-57dbabce-0267-44e8-80f5-013f158d8852" returned: 0 in 0.761s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-57dbabce-0267-44e8-80f5-013f158d8852" released by "delete_volume" :: held 1.789s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Created reservations ['8b8c5500-eecd-4961-a04c-24021229587f', 'b7d3ef9a-4c93-431b-87b2-c56f81e106bc', '696ce7aa-e814-415d-a9dd-de13378ae78a', '57ccc48f-de23-42ce-ac65-f114eea8dc01'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:22 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:22 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:54:22 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (f510c077-8772-449a-a312-fcd4eb52ecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fcf28f-2204-42e8-bdf2-c15e81fae2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fcf28f-2204-42e8-bdf2-c15e81fae2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955236586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63673a65-28fe-40f3-81bb-a2dc023e0d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:23Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:23 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c800335-d524-4fa9-864d-99b513f954e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c800335-d524-4fa9-864d-99b513f954e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a899326-6d5b-4622-9dbb-20f577c0819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a899326-6d5b-4622-9dbb-20f577c0819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63673a65-28fe-40f3-81bb-a2dc023e0d08', 'volume_name': 'volume-63673a65-28fe-40f3-81bb-a2dc023e0d08', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ca8cd7-ee8c-4c0a-8fa9-52c804980d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ca8cd7-ee8c-4c0a-8fa9-52c804980d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6c6340-6ca0-4917-b2ce-1b3153f7e2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:23 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Volume 63673a65-28fe-40f3-81bb-a2dc023e0d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63673a65-28fe-40f3-81bb-a2dc023e0d08', 'volume_size': 1} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955236586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63673a65-28fe-40f3-81bb-a2dc023e0d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:23Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Creating volume 63673a65-28fe-40f3-81bb-a2dc023e0d08 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:23 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.928s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:23 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:54:23 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 1073741824 Jul 07 22:54:23 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:23 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-ac110246-10f1-41f0-b613-7107e7ff98e4 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-57dbabce-0267-44e8-80f5-013f158d8852-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:24 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 1073741824" returned: 0 in 1.216s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:24 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:24 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 Jul 07 22:54:24 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:25 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08" returned: 0 in 0.843s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:25 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:25 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6c6340-6ca0-4917-b2ce-1b3153f7e2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63673a65-28fe-40f3-81bb-a2dc023e0d08', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5071de5-94fe-4414-8e52-1f6d3b79cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:25 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Volume volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 (63673a65-28fe-40f3-81bb-a2dc023e0d08): created successfully Jul 07 22:54:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5071de5-94fe-4414-8e52-1f6d3b79cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:25 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (f510c077-8772-449a-a312-fcd4eb52ecea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:25 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-0d3635b2-52e3-4140-834f-05678844c771 tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:54:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:26 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot f835f2ab-283c-430b-a931-79744e54ef44 of volume 63673a65-28fe-40f3-81bb-a2dc023e0d08 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:54:26 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2cbb5f-1e9c-41f2-b160-86190b7de14e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:26 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:26 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 Jul 07 22:54:26 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:27 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08" returned: 0 in 0.842s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:27 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:27 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 1G Jul 07 22:54:27 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:28 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 1G" returned: 0 in 0.812s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:28 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 Jul 07 22:54:28 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:28 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44" returned: 0 in 0.692s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:28 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 is being set with open permissions: ugo+rw Jul 07 22:54:28 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:28 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 Jul 07 22:54:28 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:29 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44" returned: 0 in 0.692s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:29 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=74,cinder:INSERT=22,cinder:UPDATE=95,cinder:DELETE=9 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:54:29 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=81,cinder:INSERT=31,cinder:UPDATE=104,cinder:DELETE=7 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:54:29 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:29 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.info Jul 07 22:54:29 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:30 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.info" returned: 0 in 0.649s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:30 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.info is being set with open permissions: ugo+rw Jul 07 22:54:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:30 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.info Jul 07 22:54:30 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:30 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.info" returned: 0 in 0.658s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:30 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.441s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:30 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-3a3fbd6b-c11c-4dfd-be2e-da05a509a433 tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-f835f2ab-283c-430b-a931-79744e54ef44-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Lock "cinder-f835f2ab-283c-430b-a931-79744e54ef44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-63673a65-28fe-40f3-81bb-a2dc023e0d08" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-63673a65-28fe-40f3-81bb-a2dc023e0d08" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-f835f2ab-283c-430b-a931-79744e54ef44" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-f835f2ab-283c-430b-a931-79744e54ef44" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot f835f2ab-283c-430b-a931-79744e54ef44 of volume 63673a65-28fe-40f3-81bb-a2dc023e0d08 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e03d5-0229-44da-b9f1-2c7f16022c16]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:31 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:31 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 Jul 07 22:54:31 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:32 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44" returned: 0 in 0.813s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:32 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63673a65-28fe-40f3-81bb-a2dc023e0d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:54:32 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83a508d-c632-4b33-95bb-8ec4bcbe23d1]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:32 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:32 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 Jul 07 22:54:32 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:33 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08" returned: 0 in 0.779s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:33 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:33 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 Jul 07 22:54:33 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:34 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44" returned: 0 in 0.761s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:34 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44 Jul 07 22:54:34 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:34 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:34 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08.f835f2ab-283c-430b-a931-79744e54ef44" returned: 0 in 0.669s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-f835f2ab-283c-430b-a931-79744e54ef44" released by "_delete_snapshot" :: held 3.125s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:34 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-63673a65-28fe-40f3-81bb-a2dc023e0d08" released by "delete_snapshot" :: held 3.149s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:34 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Created reservations ['2ed3a37b-3169-43cf-81fc-1e9c92f54632', '316127b7-7eaf-466f-ad50-6deeecd60676', '0af76379-c715-4658-b06f-70d21f9f0808', '630c5e98-ea1f-4f98-82ac-2befa9b0a7a1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:35 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:54:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-cf1fe56d-01ce-4736-8f4e-ed6fa5c1b4df tempest-ProjectMemberTests-1573472881 None] Lock "cinder-f835f2ab-283c-430b-a931-79744e54ef44-delete_snapshot" released by "delete_snapshot" :: held 3.299s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:35 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-63673a65-28fe-40f3-81bb-a2dc023e0d08-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-63673a65-28fe-40f3-81bb-a2dc023e0d08-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-63673a65-28fe-40f3-81bb-a2dc023e0d08" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:36 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-63673a65-28fe-40f3-81bb-a2dc023e0d08" acquired by "delete_volume" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:36 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97804ed-7865-4cd2-b1ed-5c37c3bdfd1e]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:36 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 Jul 07 22:54:36 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:36 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08" returned: 0 in 0.796s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:36 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:36 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08 Jul 07 22:54:36 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:37 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-63673a65-28fe-40f3-81bb-a2dc023e0d08" returned: 0 in 0.689s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-63673a65-28fe-40f3-81bb-a2dc023e0d08" released by "delete_volume" :: held 1.558s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Created reservations ['dcc545d1-e2f4-4c9a-bd10-6b324608acde', '909e5543-b73e-4779-b8d8-0ffdc5e8f1f3', '463e49db-4e0f-4385-b040-c54dc1de5655', '99977895-b44b-4efa-aeb8-958ec94159df'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:37 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:37 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:54:37 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:38 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.730s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:38 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-61245b48-256d-4a11-8eef-63f252ecf9a7 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-63673a65-28fe-40f3-81bb-a2dc023e0d08-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (f2e1efdd-35d7-4fc2-8fe2-7fc438cbeb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca6043b-f743-4818-a574-f1902d3d9940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca6043b-f743-4818-a574-f1902d3d9940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537923718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc3b926-b0b7-4fdd-8d1b-a584a39450a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:39Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6396186-db0d-4f99-809c-a1888d761638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6396186-db0d-4f99-809c-a1888d761638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48880385-3e29-476b-963e-1c7b96671987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48880385-3e29-476b-963e-1c7b96671987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc3b926-b0b7-4fdd-8d1b-a584a39450a4', 'volume_name': 'volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76af86c-59c2-4d1b-8b2e-a6c903fdba34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76af86c-59c2-4d1b-8b2e-a6c903fdba34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff05618-1103-4bca-abfd-8e78de9efc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:38 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Volume 3cc3b926-b0b7-4fdd-8d1b-a584a39450a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4', 'volume_size': 1} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537923718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc3b926-b0b7-4fdd-8d1b-a584a39450a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:39Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Creating volume 3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:38 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:54:38 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:38 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 1073741824 Jul 07 22:54:38 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:39 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 1073741824" returned: 0 in 0.833s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:39 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:39 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 Jul 07 22:54:39 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:40 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" returned: 0 in 0.675s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff05618-1103-4bca-abfd-8e78de9efc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d882c71e-e08a-4340-b0d8-b5565c71cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:40 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Volume volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 (3cc3b926-b0b7-4fdd-8d1b-a584a39450a4): created successfully Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d882c71e-e08a-4340-b0d8-b5565c71cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (f2e1efdd-35d7-4fc2-8fe2-7fc438cbeb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:40 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-48282697-3388-4044-9fa1-acf3f2c19c28 tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:40 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:41 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot c7b770ed-f82d-449d-897d-dc2ef826efc5 of volume 3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:54:41 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca22d36-7188-4156-ad0b-7117e679707b]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:41 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 Jul 07 22:54:41 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:41 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" returned: 0 in 0.758s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:41 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:41 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 1G Jul 07 22:54:41 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:42 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 1G" returned: 0 in 0.787s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:42 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:42 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 Jul 07 22:54:42 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:43 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5" returned: 0 in 0.667s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:43 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 is being set with open permissions: ugo+rw Jul 07 22:54:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:43 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 Jul 07 22:54:43 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:43 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5" returned: 0 in 0.626s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:43 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:43 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.info Jul 07 22:54:43 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:44 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.info" returned: 0 in 0.651s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:44 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.info is being set with open permissions: ugo+rw Jul 07 22:54:44 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:44 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.info Jul 07 22:54:44 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:45 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.info" returned: 0 in 0.661s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:45 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.232s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:45 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-b2bc0887-eaff-4128-9cd3-517d9f9a45cf tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-c7b770ed-f82d-449d-897d-dc2ef826efc5-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-c7b770ed-f82d-449d-897d-dc2ef826efc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-c7b770ed-f82d-449d-897d-dc2ef826efc5" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-c7b770ed-f82d-449d-897d-dc2ef826efc5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot c7b770ed-f82d-449d-897d-dc2ef826efc5 of volume 3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[d600ac2c-fc47-45dd-893a-22b8ffab16aa]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:46 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:46 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 Jul 07 22:54:46 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:47 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5" returned: 0 in 0.756s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:47 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:54:47 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5904cd-6f99-40aa-82a5-32c26c77d5df]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:47 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 Jul 07 22:54:47 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:47 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" returned: 0 in 0.779s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:47 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:47 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 Jul 07 22:54:47 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:48 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5" returned: 0 in 0.787s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:48 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:48 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5 Jul 07 22:54:48 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:49 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:49 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4.c7b770ed-f82d-449d-897d-dc2ef826efc5" returned: 0 in 0.681s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-c7b770ed-f82d-449d-897d-dc2ef826efc5" released by "_delete_snapshot" :: held 3.098s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" released by "delete_snapshot" :: held 3.122s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:49 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Created reservations ['0e6384ef-b870-4b41-a934-12b951688b12', '7aa96a21-4041-4226-9c36-dfb9da72fa0a', 'cd425e54-e52f-4044-b888-b07e04ea1bb2', '15f61c8b-f0ba-4345-99fd-09bf58670ee1'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:49 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:54:49 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-de32a58a-6f9e-43e2-b970-1d8bab7e11b9 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-c7b770ed-f82d-449d-897d-dc2ef826efc5-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:54:50 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" acquired by "delete_volume" :: waited 0.022s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:54:50 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc5aabc-cf3a-4eb4-b0e1-6f7fef7ade18]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:50 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:50 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 Jul 07 22:54:50 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:51 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" returned: 0 in 0.809s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:51 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:51 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4 Jul 07 22:54:51 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:52 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" returned: 0 in 0.687s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4" released by "delete_volume" :: held 1.566s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Created reservations ['8a5e3517-377e-456b-8201-901ae7b5fbaf', 'c2503eb1-75f5-47fa-b369-3d53ae73d058', 'ae0330ad-8038-423f-bfa8-046c77e4946f', 'a4b71939-9298-4f5d-81dd-09e7da6b7723'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:52 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:54:52 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:52 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.720s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:52 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:53 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-f4e75e41-5d6a-452f-be83-c044cc7d3e34 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-3cc3b926-b0b7-4fdd-8d1b-a584a39450a4-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87612) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (b88d5c29-8c84-42f7-9624-0a66c065c138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f52bc00-7d01-4382-ba05-336342750f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f52bc00-7d01-4382-ba05-336342750f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303050540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37261635-9c86-438f-b234-3cdd7c20329f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:53Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84523e8-d1fb-4c62-9017-643a38a74443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84523e8-d1fb-4c62-9017-643a38a74443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0042b45-c025-402f-b85b-e4dd0ff3dd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0042b45-c025-402f-b85b-e4dd0ff3dd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37261635-9c86-438f-b234-3cdd7c20329f', 'volume_name': 'volume-37261635-9c86-438f-b234-3cdd7c20329f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4e7b05-69bf-4eda-96f0-d06d5ffaf9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4e7b05-69bf-4eda-96f0-d06d5ffaf9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cafca61-ae5d-4d9b-9993-86bfa5bc0c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:53 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Volume 37261635-9c86-438f-b234-3cdd7c20329f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37261635-9c86-438f-b234-3cdd7c20329f', 'volume_size': 1} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303050540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37261635-9c86-438f-b234-3cdd7c20329f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0378e23d14e2790bf2af53f55ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:53Z,use_quota=True,user_id='505f02da3bd14c19b8e0e309e8cf5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00ea5b-47fb-429d-a27e-a0a8f26a405d),volume_type_id=8d00ea5b-47fb-429d-a27e-a0a8f26a405d)}" {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Creating volume 37261635-9c86-438f-b234-3cdd7c20329f {{(pid=87612) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Selected osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc as target Quobyte volume. {{(pid=87612) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:54:53 devstack cinder-volume[87612]: INFO cinder.volume.drivers.remotefs [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] casted to osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc Jul 07 22:54:53 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f 1073741824 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:53 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f 1073741824 Jul 07 22:54:53 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:54 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f 1073741824" returned: 0 in 0.809s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:54 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f Jul 07 22:54:54 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:54 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f" returned: 0 in 0.681s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'} {{(pid=87612) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cafca61-ae5d-4d9b-9993-86bfa5bc0c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37261635-9c86-438f-b234-3cdd7c20329f', 'volume_size': 1}' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3baf28-bb38-4831-815b-a1291d3e87d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:54:54 devstack cinder-volume[87612]: INFO cinder.volume.flows.manager.create_volume [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Volume volume-37261635-9c86-438f-b234-3cdd7c20329f (37261635-9c86-438f-b234-3cdd7c20329f): created successfully Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3baf28-bb38-4831-815b-a1291d3e87d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87612) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:54:54 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Flow 'volume_create_manager' (b88d5c29-8c84-42f7-9624-0a66c065c138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87612) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:54:54 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-e1d25e53-1646-4923-bcdf-26a7f0451129 tempest-ProjectMemberTests-1573472881 None] Created volume successfully. Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Creating offline snapshot e32915af-0dc6-43a4-a4a4-cfc8caa73f3d of volume 37261635-9c86-438f-b234-3cdd7c20329f {{(pid=87612) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[287d0c67-75fa-48b1-aa3e-4245e859ffbc]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:55 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f Jul 07 22:54:55 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:55 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:55 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:54:55 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:56 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f" returned: 0 in 0.791s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d 1G {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:56 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d 1G Jul 07 22:54:56 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:56 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:56 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-7310234f-319b-4d78-be25-801210aa3606 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.672s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:56 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:54:56 devstack cinder-volume[87612]: DEBUG oslo_service.periodic_task [None req-7310234f-319b-4d78-be25-801210aa3606 None None] Running periodic task VolumeManager._thread_info {{(pid=87612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:54:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread count: 29 {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 22:54:56 devstack cinder-volume[87612]: DEBUG cinder.volume.manager [None req-7310234f-319b-4d78-be25-801210aa3606 None None] thread info: [<_MainThread(MainThread, started 130307653144704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 22:54:57 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d 1G" returned: 0 in 0.789s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37261635-9c86-438f-b234-3cdd7c20329f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:57 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37261635-9c86-438f-b234-3cdd7c20329f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d Jul 07 22:54:57 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:57 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37261635-9c86-438f-b234-3cdd7c20329f -F qcow2 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d" returned: 0 in 0.669s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:57 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d is being set with open permissions: ugo+rw Jul 07 22:54:57 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:57 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d Jul 07 22:54:57 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:58 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d" returned: 0 in 0.648s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:58 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:58 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.info Jul 07 22:54:58 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:59 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.info" returned: 0 in 0.674s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:59 devstack cinder-volume[87612]: WARNING cinder.volume.drivers.remotefs [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.info is being set with open permissions: ugo+rw Jul 07 22:54:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.info {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:54:59 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.info Jul 07 22:54:59 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:54:59 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Jul 07 22:54:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.info" returned: 0 in 0.627s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:54:59 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.276s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:54:59 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-49e1a149-7724-48d5-aa8c-2e0b9d862f32 tempest-ProjectMemberTests-1573472881 None] Create snapshot completed successfully Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-e32915af-0dc6-43a4-a4a4-cfc8caa73f3d-delete_snapshot" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-e32915af-0dc6-43a4-a4a4-cfc8caa73f3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-37261635-9c86-438f-b234-3cdd7c20329f" by "delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-37261635-9c86-438f-b234-3cdd7c20329f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-e32915af-0dc6-43a4-a4a4-cfc8caa73f3d" by "_delete_snapshot" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-e32915af-0dc6-43a4-a4a4-cfc8caa73f3d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Deleting offline snapshot e32915af-0dc6-43a4-a4a4-cfc8caa73f3d of volume 37261635-9c86-438f-b234-3cdd7c20329f {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] snapshot_file for this snap is: volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d {{(pid=87612) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d22b6-ae22-461e-847a-0300d07c844c]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:00 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:01 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d Jul 07 22:55:01 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:01 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d" returned: 0 in 0.779s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:01 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.remotefs [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37261635-9c86-438f-b234-3cdd7c20329f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87612) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:55:01 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7219cd3-7253-4959-b66d-ed712e8a4861]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:01 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:01 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f Jul 07 22:55:01 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:02 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f" returned: 0 in 0.810s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:02 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:02 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d Jul 07 22:55:02 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:03 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d" returned: 0 in 0.854s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:03 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:03 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d Jul 07 22:55:03 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:04 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:04 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f.e32915af-0dc6-43a4-a4a4-cfc8caa73f3d" returned: 0 in 0.712s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-e32915af-0dc6-43a4-a4a4-cfc8caa73f3d" released by "_delete_snapshot" :: held 3.265s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-37261635-9c86-438f-b234-3cdd7c20329f" released by "delete_snapshot" :: held 3.290s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:04 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Created reservations ['658be698-21d2-4c36-812f-048d131a8e87', '0ee1ab48-d1b8-40cf-aaf7-051ea167339b', '34ce7131-9b31-46dd-b376-836b0e1435ba', '48780c2f-027c-4e27-8302-4679628a0889'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:04 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Delete snapshot completed successfully. Jul 07 22:55:04 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0c202749-cca0-4445-8262-a3ed98ab518e tempest-ProjectMemberTests-1573472881 None] Lock "cinder-e32915af-0dc6-43a4-a4a4-cfc8caa73f3d-delete_snapshot" released by "delete_snapshot" :: held 3.446s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-37261635-9c86-438f-b234-3cdd7c20329f-delete_volume" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-37261635-9c86-438f-b234-3cdd7c20329f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "cinder-quobyte-37261635-9c86-438f-b234-3cdd7c20329f" by "delete_volume" {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:55:05 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-37261635-9c86-438f-b234-3cdd7c20329f" acquired by "delete_volume" :: waited 0.015s {{(pid=87612) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:55:05 devstack cinder-volume[87612]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e89f9fc-6ab5-4483-b00d-97892632d5fc]: (4, 'qcow2') {{(pid=88825) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:55:05 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:05 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f Jul 07 22:55:05 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:06 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f" returned: 0 in 0.792s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:06 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f Jul 07 22:55:06 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:06 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8/volume-37261635-9c86-438f-b234-3cdd7c20329f" returned: 0 in 0.687s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-quobyte-37261635-9c86-438f-b234-3cdd7c20329f" released by "delete_volume" :: held 1.535s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG cinder.quota [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Created reservations ['ccbd1b32-b44c-411c-9508-df2f0cc7f230', '25764947-5e93-424c-b6e7-205a5416ff9e', 'f81cbb06-56b0-41b6-9931-d4a2edd8fb42', '5f4d0e56-d85d-4a37-a8fe-c20f47f5f219'] {{(pid=87612) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc': None} {{(pid=87612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG cinder.volume.drivers.quobyte [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a8e5a9d-c8ba-4a35-8647-91684dad26fc'] {{(pid=87612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.lockutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:55:06 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:55:06 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8 Jul 07 22:55:06 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:55:07 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Jul 07 22:55:07 devstack cinder-volume[87612]: DEBUG oslo_concurrency.processutils [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9326816e41e39713c677b0d2b8b608f8" returned: 0 in 0.740s {{(pid=87612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:55:07 devstack cinder-volume[87612]: DEBUG cinder.manager [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Notifying Schedulers of capabilities ... {{(pid=87612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:55:07 devstack cinder-volume[87612]: INFO cinder.volume.manager [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Deleted volume successfully. Jul 07 22:55:07 devstack cinder-volume[87612]: DEBUG cinder.coordination [None req-0148a8e5-c8c3-44e0-b7d1-c2b2bb5e2d30 tempest-ProjectMemberTests-1573472881 None] Lock "cinder-37261635-9c86-438f-b234-3cdd7c20329f-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=87612) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:55:16 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=38,cinder:DELETE=4,cinder:INSERT=16,cinder:UPDATE=49 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:55:17 devstack cinder-volume[87612]: DEBUG dbcounter [-] [87612] Writing DB stats cinder:SELECT=40,cinder:INSERT=13,cinder:UPDATE=52,cinder:DELETE=4 {{(pid=87612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}